-- Logs begin at Thu 2022-05-26 11:43:36 UTC, end at Thu 2022-05-26 13:00:31 UTC. -- May 26 12:23:06.988293 dv-cinder-815145-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 12:23:06.999384 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 12:23:07.002035 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 12:23:06 2022] *** May 26 12:23:07.002035 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 12:23:07.002035 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 12:23:07.002035 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: nodename: dv-cinder-815145-10-iscsi May 26 12:23:07.002035 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: machine: x86_64 May 26 12:23:07.002035 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: clock source: unix May 26 12:23:07.002035 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: pcre jit disabled May 26 12:23:07.002035 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: detected number of CPU cores: 4 May 26 12:23:07.002035 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: current working directory: / May 26 12:23:07.002035 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: detected binary path: /usr/bin/uwsgi-core May 26 12:23:07.003124 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: your processes number limit is 47680 May 26 12:23:07.003124 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: your memory page size is 4096 bytes May 26 12:23:07.003124 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: detected max file descriptor number: 2048 May 26 12:23:07.003124 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: lock engine: pthread robust mutexes May 26 12:23:07.003124 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: thunder lock: enabled May 26 12:23:07.003124 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 12:23:07.003124 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 12:23:07.046618 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: Python main interpreter initialized at 0x562ed29cf9c0 May 26 12:23:07.046618 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: python threads support enabled May 26 12:23:07.046618 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: your server socket listen backlog is limited to 100 connections May 26 12:23:07.046618 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: your mercy for graceful operations on workers is 90 seconds May 26 12:23:07.046959 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: mapped 403077 bytes (393 KB) for 2 cores May 26 12:23:07.047044 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: *** Operational MODE: preforking *** May 26 12:23:07.047268 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: *** uWSGI is running in multiple interpreter mode *** May 26 12:23:07.047268 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: spawned uWSGI master process (pid: 103043) May 26 12:23:07.047458 dv-cinder-815145-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 12:23:07.048825 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: spawned uWSGI worker 1 (pid: 103044, cores: 1) May 26 12:23:07.050111 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: spawned uWSGI worker 2 (pid: 103045, cores: 1) May 26 12:23:07.050111 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 12:23:08.226347 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 12:23:08.231373 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 12:23:08.967215 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:23:08.967215 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: from cryptography.utils import int_from_bytes May 26 12:23:08.967442 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:23:08.967442 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: from cryptography.utils import int_from_bytes May 26 12:23:08.967741 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:23:08.967741 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: from cryptography.utils import int_from_bytes May 26 12:23:08.967925 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:23:08.967925 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: from cryptography.utils import int_from_bytes May 26 12:23:11.560241 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 12:23:11.560914 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 12:23:11.560914 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 12:23:11.561345 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 12:23:11.561345 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 12:23:11.561564 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 12:23:11.561632 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 12:23:11.561705 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 12:23:11.561771 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 12:23:11.561850 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 12:23:11.562003 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.562086 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.562332 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.562426 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.562653 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.562754 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.562973 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.563075 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.563304 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.563411 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.564163 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.564321 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.564479 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.564635 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.564807 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.564937 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.565127 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.565218 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.565394 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.565480 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.565717 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.565810 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.566047 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815145-10-iscsi {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.566133 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815145-10-iscsi {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.566374 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.566465 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.566685 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.566835 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.566996 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.567099 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.567315 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.567412 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.567622 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.567717 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.567947 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.568040 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.568255 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.568341 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.568772 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.568894 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.569205 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.569358 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.569497 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.569641 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.569806 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.569957 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.570145 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.570288 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.570464 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.570614 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.570772 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.570904 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.571095 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.571232 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.571403 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.571537 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.571727 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.571860 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.572038 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.572174 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.572433 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815145-10-iscsi {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.572556 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815145-10-iscsi {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.572769 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.572907 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.573088 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.573215 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.573404 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.573541 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.573817 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.573966 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.574128 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.574255 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.574440 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.574570 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.574759 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.574883 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.575081 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.575208 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.575390 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.575514 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.575715 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.575846 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.576034 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.576166 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.576351 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.576476 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.576669 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.576843 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.576998 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.577132 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.577308 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.577437 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.577614 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.577744 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.577931 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.578069 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.578236 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.578359 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.578537 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.578668 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.578796 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.578927 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.579103 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.579840 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.579966 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.580088 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.580350 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.580475 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.580597 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.580751 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.580964 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.581092 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.581225 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.581362 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.581498 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.581629 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.581763 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.581900 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.582032 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.582155 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.582300 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.582426 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.582611 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.582746 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.582920 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.583046 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.583228 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.583362 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.583539 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.583665 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.583843 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.583966 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.584141 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.584272 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.584456 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.584587 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.584793 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.584919 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.585119 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.585258 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.585428 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.585554 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.585750 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.585876 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.586148 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.586274 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.586405 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.586528 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.586717 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.586848 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.587032 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.587167 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.587352 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.587476 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.587659 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.587790 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.587979 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.588186 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.588312 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.588441 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.588593 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.588738 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.588927 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.589063 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.589235 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.589360 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.589555 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.589679 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.589877 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.590013 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.590184 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.590308 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.590430 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.590551 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.590720 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.590855 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.591025 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.591157 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.591343 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.591470 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.591648 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.591774 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.591954 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.592099 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.592260 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.592394 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.592560 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.592687 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.592892 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.593017 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.593199 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.593323 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.593507 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.593632 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.593810 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.593934 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.594115 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.594247 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.594420 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.594544 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.594749 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.594968 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.595135 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.595267 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.595390 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.595516 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.595661 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.595830 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.595985 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.596152 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.596286 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.596459 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.596585 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.596790 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.596930 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.597100 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.597237 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.597406 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.597533 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.597728 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.597855 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.598035 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.598170 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.598341 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.598468 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.598660 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.598824 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.598956 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.599083 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.599264 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.599391 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.599583 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.599709 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.600136 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.600284 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.600444 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.600571 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.600770 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.600900 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.601073 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.601198 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.601381 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.601514 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.601690 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.601814 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.601993 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.602123 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.602299 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.602422 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.602600 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.602732 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.602901 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.603028 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.603204 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.603330 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.603508 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.603644 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.603806 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.603929 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.604107 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.604237 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.604403 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.604539 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.604730 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.604859 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.605058 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.605181 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.605361 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.605495 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.605667 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.605793 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.605972 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.606098 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.606288 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:11.606421 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.606620 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.606746 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.606952 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.607078 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.607266 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.607390 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.607594 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.607718 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.607925 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.608049 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.608247 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.608382 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.608563 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.608686 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.608904 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.609041 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.609221 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.609345 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.609535 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.609700 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.609845 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.609985 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.610158 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.610312 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.610509 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.610644 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.610828 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.610957 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.611160 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.611297 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.611467 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.611600 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.611785 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.611919 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.612107 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.612234 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.612422 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.612549 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.612773 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.612916 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.613074 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.613201 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.613398 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.613524 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.613713 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.613850 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.614021 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.614145 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.614363 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.614489 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.614690 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.614826 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.615011 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.615143 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.615331 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.615457 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.615648 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.615781 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.615958 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.616089 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.616270 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.616394 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.616582 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.616734 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.616932 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.617059 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.617253 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.617370 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.617567 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.617700 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.617881 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.618005 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.618191 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.618315 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.618503 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.618634 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.618810 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.618934 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.619125 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.619258 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.619434 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.619575 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.619767 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.619890 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.620080 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.620216 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.620395 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.620519 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.620707 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.620869 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.621047 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.621174 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.621358 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.621489 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.621670 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.621800 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.621979 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.622114 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.622285 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.622408 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.622588 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.622713 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.622894 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.623021 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.623199 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.623329 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.623502 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.623626 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.623822 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.623957 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.624134 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.624258 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.624443 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.624574 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.624796 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.624923 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.625105 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.625229 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.625418 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.625557 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.625727 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.625852 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.626545 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.626675 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.626854 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.627003 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.627176 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.627302 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.627464 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.627598 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.627771 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.627914 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.628096 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.628224 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.628406 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.628532 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.628753 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.628901 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.629060 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.629187 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.629372 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.629499 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.629675 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.629810 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.629993 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.630137 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.630308 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.630431 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.630619 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.630786 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.631000 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.631125 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.631312 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.631437 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.631635 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.631760 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.631948 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.632073 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.632265 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.632393 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.632603 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.632752 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.632936 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.633062 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.633255 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.633380 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.633580 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.633715 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.633899 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.634024 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.634209 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.634344 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.634512 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.634637 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.634819 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.634942 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.635122 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.635259 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.635428 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.635555 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.635734 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.635860 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.636038 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.636170 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.636340 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.636464 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.636646 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.636816 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.636975 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.637112 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.637281 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.637408 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.637584 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.637712 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.637904 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.638035 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.638210 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.638335 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.638515 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.638644 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.638850 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.638976 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.639099 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.639230 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.639447 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.639580 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.639753 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.639879 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.640093 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.640219 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.640417 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.640548 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.640753 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.640881 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.641073 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.641205 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.641385 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.641518 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.642238 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.642454 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.642603 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.642734 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.642870 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.643029 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.643169 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.643352 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.643478 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.643678 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.643812 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.643996 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.644123 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.644322 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.644448 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.644638 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.644788 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.644993 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.645121 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.645311 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.645437 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.645632 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.645756 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.645940 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.646077 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.646257 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.646384 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.646597 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.646736 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.646931 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.647059 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.647249 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.647387 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.647575 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.647705 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.647888 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.648013 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.648205 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.648331 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.648516 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.648650 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.648852 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.648977 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.649168 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.649303 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.649483 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.649620 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.649804 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.649935 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.650118 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.650243 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.650436 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.650569 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.650745 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.650869 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.651065 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.651189 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.651377 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.651504 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.651694 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.651821 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.651999 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.652123 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.652313 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.652439 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.652642 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.652800 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.653001 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.653128 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.653312 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.653440 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.653624 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.653751 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.653947 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.654070 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.654257 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.654384 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.654565 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.654692 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.654877 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.655011 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.655184 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.655310 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.655489 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.655609 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.655798 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.655942 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.656113 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.656237 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.656422 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.656550 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.656747 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.656893 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.657058 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.657223 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.657412 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.657610 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.657803 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.658023 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.658200 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.658367 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.658536 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.658707 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.658887 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.659054 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.659215 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.659387 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.659567 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.659733 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.659872 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.659996 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.660118 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.660240 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.660361 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.660482 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.660613 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.660769 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.660894 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.661041 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.661200 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.661360 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.661511 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.661675 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.661809 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.661987 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.662113 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.662299 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.662427 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.662653 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.662781 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.662970 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.663103 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.663283 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.663410 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.663606 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.663732 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.663932 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.664058 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.664245 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.664388 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.664557 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.664683 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.664895 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.665022 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.665210 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.665342 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.665523 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.665653 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.665835 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.665971 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.666147 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.666271 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.666457 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.666581 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.666769 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.666903 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.667081 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.667214 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.667394 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.667521 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.667702 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.667835 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.668016 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.668149 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.668330 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.668460 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.668634 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.668857 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.668984 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.669105 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.669270 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.669403 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.669591 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.669842 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.670159 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.670286 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.670482 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.670606 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.670803 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.670930 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.671125 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.671252 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.671445 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.671565 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.671768 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.671899 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.672095 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.672219 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.672432 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.672555 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.672758 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.673407 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.673606 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.673743 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.673915 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.674042 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.674223 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.674350 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.674538 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.674676 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.674846 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.674973 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.675157 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.675281 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.675462 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.675586 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.675770 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.675902 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.676073 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.676196 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.676381 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.676506 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.676684 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.676836 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.677015 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.677150 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.677323 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.677448 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.677628 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.677751 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.677936 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.678068 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.678240 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.678370 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.678548 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.678671 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.678861 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.678993 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.679168 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.679294 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.679476 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.679600 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.679779 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.679911 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.680085 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.680216 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.680415 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.680539 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.680767 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.680908 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.681092 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.681226 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.681425 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.681552 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.681737 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.681859 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.682042 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.682148 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.682364 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.682465 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.682671 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.682770 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.682976 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.683081 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.683280 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.683377 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.683585 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.683681 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.683891 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.683988 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.684194 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.684300 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.684499 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.684594 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.684831 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.684928 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.685145 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.685256 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.685457 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.685560 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.685766 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.685878 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.686074 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.686216 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.686376 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.686501 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.686683 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.686807 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.686990 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.687130 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.687294 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.687420 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.687598 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.687730 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.687902 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.688027 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.688207 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.688337 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.689094 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.689228 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.689415 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.689543 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.689721 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.689845 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.690031 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.690164 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.690337 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.690462 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.690642 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.690776 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.690947 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.691081 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.691525 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.691651 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.691869 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.692002 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.692127 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.692257 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.692443 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.692576 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.692773 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.692914 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.693119 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.693257 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.693425 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.693552 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.693730 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.693855 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.694033 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.694240 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.694385 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.694506 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.694629 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.694751 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.694928 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.695064 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.695243 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.695368 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.695547 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.695672 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.695851 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.695988 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.696163 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.696287 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.696460 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.696584 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.696784 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.696922 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.697094 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.697226 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.697396 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.697520 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.697698 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.697830 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.697996 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.698128 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.698299 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.698432 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.698600 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.698725 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.698907 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.699041 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.699220 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.699353 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.699526 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.699653 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.699832 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.699955 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.700136 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.700268 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.700441 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.700566 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.700796 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.700936 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.701107 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.701240 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.701452 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.701577 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.701766 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.701884 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.702083 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.702217 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.702395 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.702528 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.702707 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.702839 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.703019 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.703142 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.703322 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.703453 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.703633 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.703757 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.703942 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.704085 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.704281 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.704445 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.704572 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.704896 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.705037 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.705215 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.705342 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.705527 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.705651 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.705840 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.705979 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.706158 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.706286 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.706476 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.706602 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.706796 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.706929 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.707103 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.707229 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.707414 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.707540 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.707725 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.707853 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.708034 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.708160 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.708344 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.708476 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.708653 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.708819 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.708986 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.709111 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.709295 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.709419 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.709606 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.709772 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.709917 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.710044 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.710228 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.710380 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.710537 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.710674 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.710847 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.710971 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.711153 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.711286 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.711461 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.711587 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.711770 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.711901 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.712079 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.712213 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.712381 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.712506 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.712692 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.712840 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.713022 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.713166 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.713333 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.713459 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.713641 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.713872 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.714071 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.714385 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.714511 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.714694 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.714912 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.715038 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.715297 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.715608 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.715732 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.715925 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.716140 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.716267 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.716534 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.716667 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.716988 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.717224 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.717352 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.717602 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.717795 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.717921 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.718206 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.718336 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.718512 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.718637 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.718821 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.718947 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.719145 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.719279 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.719453 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.719588 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.719826 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.719954 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.720189 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.720518 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.720643 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.720853 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.720981 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.721176 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.721300 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.721496 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.721630 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.721818 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.721951 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.722153 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.722278 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.722475 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.722602 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.722799 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.722922 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.723131 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.723257 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.723463 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.723604 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.723775 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.723901 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.724105 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.724230 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.724443 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.724641 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.724801 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.725171 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.725339 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.725466 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.725669 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.725809 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.725997 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.726124 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.726311 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.726447 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.726627 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.726755 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.726934 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.727069 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.727258 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.727385 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.727582 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.727708 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.727898 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.728039 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.728223 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.728349 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.728593 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.728734 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.728951 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.729086 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.729270 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.729397 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.729592 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.729719 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.729905 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.730032 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.730213 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.730341 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.730522 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.730648 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.730834 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.730963 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.731142 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.731268 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.731452 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.731578 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.731777 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.731903 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.732085 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.732212 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.732399 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.732538 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.732726 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.732855 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.733048 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.733176 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.733354 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.733493 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.733660 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.733787 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.733984 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.734118 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.734290 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.734425 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.734613 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.734748 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.734928 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.735056 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.735250 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.735952 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.736178 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.736313 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.736497 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.736622 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.736852 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.736982 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.737172 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.737312 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.737484 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.737611 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.737794 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.737921 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.738103 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.738230 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.738451 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.738575 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.738760 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.738885 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.739083 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.739216 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.739394 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.739519 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.739726 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.739853 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.740041 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.740174 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.740352 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.740486 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.740662 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.740804 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.740999 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.741125 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.741345 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.741479 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.741657 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.741782 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.741969 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.742097 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.742276 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.742404 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.742591 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.742726 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.742902 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.743028 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.743210 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.743337 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.743519 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.743646 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.743830 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.743956 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.744135 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.744262 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.744440 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.744575 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.744767 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.744898 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.745093 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.745221 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.745402 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.745528 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.745726 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.745852 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.746036 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.746162 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.746342 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.746463 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.746645 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.746788 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.746952 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.747076 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.747261 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.747395 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.747571 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.747707 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.747899 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.748026 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.748211 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.748337 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.748532 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.748665 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.748871 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.749007 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.749186 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.749319 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.749496 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.749636 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.749808 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.749934 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.750122 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.750247 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.750442 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.750569 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.750758 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.750893 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.751673 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.751810 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.752001 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.752128 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.752323 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.752449 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.752638 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.752807 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.752984 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.753118 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.753302 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.753436 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.753623 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.753756 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.753951 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.754148 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.754275 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.754482 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.754608 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.754803 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.754938 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.755121 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.755247 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.755437 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.755564 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.755756 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.755883 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.756074 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.756208 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.756390 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.756517 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.756704 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.756944 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.757071 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.757294 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.757431 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.757639 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.757775 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.757963 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.758096 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.758285 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.758411 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.758608 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.758735 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.758928 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.759052 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.759245 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.759370 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.759562 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.759694 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.759876 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.760002 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.760195 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.760323 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.760528 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.760663 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.760854 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.760978 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.761166 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.761300 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.761485 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.761611 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.761800 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.761935 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.762116 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.762251 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.762426 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.762553 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.762740 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.762874 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.763055 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.763182 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.763370 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.763497 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.763681 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.763808 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.763997 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.764125 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.764311 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.764431 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.764628 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.764780 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.764970 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.765108 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.765288 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.765417 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.765602 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.765800 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.765925 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.766047 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.766221 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.766348 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.766538 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.766766 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.766893 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.767086 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.767212 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.767524 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.767650 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.767866 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.768002 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.768192 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.768319 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.768512 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.768647 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.768855 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.768987 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.769181 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.769307 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.769488 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.769706 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.769834 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.770027 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.770153 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.770365 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.770492 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.770688 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.770814 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.771011 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.771138 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.771325 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.771451 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.771635 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.771761 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.771956 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.772083 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.772265 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.772397 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.772582 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.772819 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.772949 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.773169 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.773296 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.773485 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.773612 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.773813 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.773948 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.774129 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.774253 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.774443 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.774576 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.774750 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.774876 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.775067 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.775201 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.775373 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.775605 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.775732 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.775957 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.776095 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.776279 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.776405 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.776582 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.776706 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.776926 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.777055 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.777240 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.777373 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.777548 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.777675 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.777854 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.778014 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.778189 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.778324 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.778498 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.778623 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.778820 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.778953 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.779126 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.779251 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.779434 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.779558 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.779742 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.779881 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.780055 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.780179 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.780360 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.780492 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.780665 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.780878 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.780995 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.781116 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.781289 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.781423 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.781602 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.781741 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.781908 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.782042 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.782250 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.782403 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.782574 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.782695 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.782891 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.783018 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.783201 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.783336 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.783511 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.783639 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.783819 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.783946 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.784128 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.784254 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.784443 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.784570 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.784780 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.784919 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.785096 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.785229 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.785405 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.785533 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.785723 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.785849 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.786033 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.786165 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.786344 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.786476 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.786687 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.786812 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.787005 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.787141 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.787313 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.787538 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.787666 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.787873 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.788000 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.788194 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.788322 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.788527 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.788655 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.788867 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.788994 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.789184 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.789309 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.789492 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.789618 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.789807 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.789933 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.790132 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.790359 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.790486 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.790698 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.790825 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.791023 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.791150 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.791335 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.791460 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.791645 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.791772 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.791955 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.792083 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.792265 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.792392 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.792575 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.792702 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.792915 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.793042 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.793227 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.793361 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.793538 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.793671 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.793846 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.793978 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.794155 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.794280 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.794469 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.794603 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.794780 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.794912 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.795094 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.795221 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.795409 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.795611 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.795764 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.795892 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.796079 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.796205 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.796394 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.796521 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.796706 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.796877 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.797041 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.797167 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.797351 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.797479 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.797670 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.798304 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.798529 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.798848 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.799021 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.799213 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.799344 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.799477 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.799601 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.799733 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.799857 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.799987 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.800150 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.800275 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.800464 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.800600 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.800801 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.800929 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.801125 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.801251 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.801448 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.801586 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.801761 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.801888 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.802069 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.802194 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.802382 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.802514 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.802711 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.802838 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.803049 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.803175 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.803378 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.803506 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.803704 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.803843 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.804010 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.804137 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.804316 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.804444 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.804622 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.804779 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.804959 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.805098 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.805279 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.805406 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.805589 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.805715 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.805894 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.806029 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.806199 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.806325 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.806510 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.806637 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.806820 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.806954 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.807126 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.807253 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.807433 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.807559 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.807731 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.807870 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.808032 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.808166 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.808335 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.808462 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.808641 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.808784 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.808973 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.809099 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.809278 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.809403 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.809585 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.809710 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.809875 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.809999 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.810184 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.810360 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.810534 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.810658 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.810781 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.810903 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.811080 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.811206 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.811385 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.811509 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.811689 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.811822 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.811998 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.812132 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.812306 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.812435 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.812615 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.812763 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.812956 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.813095 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.813268 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.813393 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.814118 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.814335 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.814468 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.814601 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.814725 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.814849 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.815012 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.815139 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.815351 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.815491 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.815691 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.815825 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.816010 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.816137 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.816320 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.816446 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.816636 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.816806 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.816976 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.817102 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.817289 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.817414 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.817597 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.817730 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.817908 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.818036 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.818234 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.818366 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.818548 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.818676 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.818855 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.818989 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.819181 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.819309 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.819496 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.819628 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.819813 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.819949 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.820127 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.820252 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.820438 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.820562 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.820770 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.820916 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.821101 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.821228 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.821413 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.821540 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.821730 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.821874 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.822043 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.822171 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.822355 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.822482 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.822672 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.822799 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.822989 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.823110 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.823302 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.823427 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.823628 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.823753 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.823940 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.824066 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.824248 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.824374 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.824568 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.824695 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.824909 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.825035 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.825226 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.825429 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.825554 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.825676 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.825852 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.825986 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.826183 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.826322 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.826495 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.826619 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.826801 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.826928 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.827051 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 12:23:11.827186 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.827442 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.827795 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.828113 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.828460 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.828822 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.829171 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.829487 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.829795 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:11.830042 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 12:23:11.886195 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO dbcounter [None req-177f5c73-af9e-452b-94f7-98e7c45a8ed0 None None] Registered counter for database nova_api May 26 12:23:11.889438 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO dbcounter [None req-69f16ee1-7b85-4fa1-bb7f-ddf460137285 None None] Registered counter for database nova_api May 26 12:23:11.906323 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG oslo_db.sqlalchemy.engines [None req-177f5c73-af9e-452b-94f7-98e7c45a8ed0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103045) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:23:11.908635 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG oslo_db.sqlalchemy.engines [None req-69f16ee1-7b85-4fa1-bb7f-ddf460137285 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103044) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:23:11.913386 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG dbcounter [-] [103045] Writer thread running {{(pid=103045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:23:11.915133 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG dbcounter [-] [103044] Writer thread running {{(pid=103044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:23:11.971402 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.context [None req-177f5c73-af9e-452b-94f7-98e7c45a8ed0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),647fb890-3516-4fd3-bb90-bcfdb9dc4d4a(cell1) {{(pid=103045) load_cells /opt/stack/nova/nova/context.py:464}} May 26 12:23:11.972196 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.context [None req-69f16ee1-7b85-4fa1-bb7f-ddf460137285 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),647fb890-3516-4fd3-bb90-bcfdb9dc4d4a(cell1) {{(pid=103044) load_cells /opt/stack/nova/nova/context.py:464}} May 26 12:23:11.975790 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG oslo_concurrency.lockutils [None req-177f5c73-af9e-452b-94f7-98e7c45a8ed0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:23:11.976522 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG oslo_concurrency.lockutils [None req-69f16ee1-7b85-4fa1-bb7f-ddf460137285 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:23:11.977448 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG oslo_concurrency.lockutils [None req-177f5c73-af9e-452b-94f7-98e7c45a8ed0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:23:11.978140 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG oslo_concurrency.lockutils [None req-69f16ee1-7b85-4fa1-bb7f-ddf460137285 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:23:11.978241 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG oslo_concurrency.lockutils [None req-177f5c73-af9e-452b-94f7-98e7c45a8ed0 None None] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:23:11.978934 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG oslo_concurrency.lockutils [None req-69f16ee1-7b85-4fa1-bb7f-ddf460137285 None None] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:23:11.980201 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG oslo_concurrency.lockutils [None req-177f5c73-af9e-452b-94f7-98e7c45a8ed0 None None] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:23:11.980937 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG oslo_concurrency.lockutils [None req-69f16ee1-7b85-4fa1-bb7f-ddf460137285 None None] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:23:11.982244 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO dbcounter [None req-177f5c73-af9e-452b-94f7-98e7c45a8ed0 None None] Registered counter for database nova_cell0 May 26 12:23:11.982932 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO dbcounter [None req-69f16ee1-7b85-4fa1-bb7f-ddf460137285 None None] Registered counter for database nova_cell0 May 26 12:23:11.987005 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO dbcounter [None req-177f5c73-af9e-452b-94f7-98e7c45a8ed0 None None] Registered counter for database nova_cell1 May 26 12:23:11.987406 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO dbcounter [None req-69f16ee1-7b85-4fa1-bb7f-ddf460137285 None None] Registered counter for database nova_cell1 May 26 12:23:11.994986 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG oslo_db.sqlalchemy.engines [None req-177f5c73-af9e-452b-94f7-98e7c45a8ed0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103045) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:23:11.998105 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG oslo_db.sqlalchemy.engines [None req-177f5c73-af9e-452b-94f7-98e7c45a8ed0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103045) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:23:11.998678 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG oslo_db.sqlalchemy.engines [None req-69f16ee1-7b85-4fa1-bb7f-ddf460137285 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103044) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:23:12.001898 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG oslo_db.sqlalchemy.engines [None req-69f16ee1-7b85-4fa1-bb7f-ddf460137285 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103044) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:23:12.004748 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG dbcounter [-] [103045] Writer thread running {{(pid=103045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:23:12.005109 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG dbcounter [-] [103045] Writer thread running {{(pid=103045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:23:12.006322 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG dbcounter [-] [103044] Writer thread running {{(pid=103044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:23:12.009394 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG dbcounter [-] [103044] Writer thread running {{(pid=103044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:23:12.152638 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO dbcounter [None req-177f5c73-af9e-452b-94f7-98e7c45a8ed0 None None] Registered counter for database nova_cell0 May 26 12:23:12.155586 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO dbcounter [None req-69f16ee1-7b85-4fa1-bb7f-ddf460137285 None None] Registered counter for database nova_cell0 May 26 12:23:12.162041 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG oslo_db.sqlalchemy.engines [None req-177f5c73-af9e-452b-94f7-98e7c45a8ed0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103045) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:23:12.165741 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG oslo_db.sqlalchemy.engines [None req-69f16ee1-7b85-4fa1-bb7f-ddf460137285 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103044) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:23:12.166522 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG dbcounter [-] [103045] Writer thread running {{(pid=103045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:23:12.170135 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG dbcounter [-] [103044] Writer thread running {{(pid=103044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:23:12.507361 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: WARNING keystonemiddleware.auth_token [None req-69f16ee1-7b85-4fa1-bb7f-ddf460137285 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:23:12.509631 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: WARNING keystonemiddleware.auth_token [None req-177f5c73-af9e-452b-94f7-98e7c45a8ed0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:23:12.514604 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: WARNING keystonemiddleware.auth_token [None req-69f16ee1-7b85-4fa1-bb7f-ddf460137285 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:23:12.516900 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: WARNING keystonemiddleware.auth_token [None req-177f5c73-af9e-452b-94f7-98e7c45a8ed0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:23:12.858577 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: WARNING keystonemiddleware.auth_token [None req-69f16ee1-7b85-4fa1-bb7f-ddf460137285 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:23:12.860931 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: WARNING keystonemiddleware.auth_token [None req-177f5c73-af9e-452b-94f7-98e7c45a8ed0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:23:12.864788 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: WARNING keystonemiddleware.auth_token [None req-69f16ee1-7b85-4fa1-bb7f-ddf460137285 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:23:12.866877 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: WARNING keystonemiddleware.auth_token [None req-177f5c73-af9e-452b-94f7-98e7c45a8ed0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:23:12.870041 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562ed29cf9c0 pid: 103044 (default app) May 26 12:23:12.872115 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562ed29cf9c0 pid: 103045 (default app) May 26 12:23:12.872216 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-69f16ee1-7b85-4fa1-bb7f-ddf460137285 None None] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:23:12.873324 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-69f16ee1-7b85-4fa1-bb7f-ddf460137285 None None] 10.222.0.39 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001778 May 26 12:23:12.873742 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 788 bytes} [Thu May 26 12:23:12 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:24:31.323591 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-177f5c73-af9e-452b-94f7-98e7c45a8ed0 None None] Calling method '>' {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:24:31.324932 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-177f5c73-af9e-452b-94f7-98e7c45a8ed0 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002048 May 26 12:24:31.325342 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 930 bytes} [Thu May 26 12:24:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:24:31.336388 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG dbcounter [-] [103044] Writing DB stats nova_api:SELECT=3 {{(pid=103044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:31.338006 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG dbcounter [-] [103044] Writing DB stats nova_cell0:SELECT=3 {{(pid=103044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:31.339252 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG dbcounter [-] [103044] Writing DB stats nova_cell1:SELECT=3 {{(pid=103044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:31.340232 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG dbcounter [-] [103044] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:31.799826 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-0779b7b7-cf8c-4611-9a2d-9b732174e298 admin admin] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:24:31.830219 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-0779b7b7-cf8c-4611-9a2d-9b732174e298 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.498911 May 26 12:24:31.830985 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 2/3] 10.222.0.39 () {60 vars in 1291 bytes} [Thu May 26 12:24:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:24:34.126270 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-177f5c73-af9e-452b-94f7-98e7c45a8ed0 None None] Calling method '>' {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:24:34.127909 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-177f5c73-af9e-452b-94f7-98e7c45a8ed0 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002039 May 26 12:24:34.128308 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 2/4] 10.222.0.39 () {54 vars in 930 bytes} [Thu May 26 12:24:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:24:34.196815 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-c59fe3dc-c525-40fe-9253-40cd142b84a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "os-flavor-access:is_public": true, "id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0}} {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:24:34.215556 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:24:34.215556 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: warnings.warn(msg) May 26 12:24:34.252438 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-c59fe3dc-c525-40fe-9253-40cd142b84a5 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.118060 May 26 12:24:34.253178 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 3/5] 10.222.0.39 () {64 vars in 1282 bytes} [Thu May 26 12:24:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:24:34.267159 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG dbcounter [-] [103045] Writing DB stats nova_api:SELECT=3 {{(pid=103045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:34.268345 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG dbcounter [-] [103045] Writing DB stats nova_cell0:SELECT=3 {{(pid=103045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:34.269814 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG dbcounter [-] [103045] Writing DB stats nova_cell1:SELECT=3 {{(pid=103045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:34.270687 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG dbcounter [-] [103045] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:34.474808 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-3c36bdbf-886f-4e99-adef-50f6a4ef1460 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:24:34.477244 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:24:34.477244 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: warnings.warn(msg) May 26 12:24:34.545743 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-3c36bdbf-886f-4e99-adef-50f6a4ef1460 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284366 May 26 12:24:34.546815 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 3/6] 10.222.0.39 () {64 vars in 1335 bytes} [Thu May 26 12:24:34 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:24:36.832776 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-c59fe3dc-c525-40fe-9253-40cd142b84a5 admin admin] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:24:36.833794 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-c59fe3dc-c525-40fe-9253-40cd142b84a5 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 May 26 12:24:36.834454 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 4/7] 10.222.0.39 () {54 vars in 930 bytes} [Thu May 26 12:24:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:24:36.953738 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-7f808143-2377-4820-a677-f11c32ca539d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "name": "ds512M", "rxtx_factor": 1.0, "id": "d1"}} {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:24:36.971425 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:24:36.971425 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: warnings.warn(msg) May 26 12:24:36.990213 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-7f808143-2377-4820-a677-f11c32ca539d admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.148729 May 26 12:24:36.990791 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 4/8] 10.222.0.39 () {64 vars in 1282 bytes} [Thu May 26 12:24:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:24:37.003940 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-e1a4602e-5971-4593-b545-9b5ca724e169 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:24:37.005476 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:24:37.005476 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: warnings.warn(msg) May 26 12:24:37.037258 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-e1a4602e-5971-4593-b545-9b5ca724e169 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037355 May 26 12:24:37.037844 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 5/9] 10.222.0.39 () {64 vars in 1335 bytes} [Thu May 26 12:24:36 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:24:39.314309 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-7f808143-2377-4820-a677-f11c32ca539d admin admin] Calling method '>' {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:24:39.315667 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-7f808143-2377-4820-a677-f11c32ca539d admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001808 May 26 12:24:39.316218 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 930 bytes} [Thu May 26 12:24:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:24:39.379152 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-a51c8b1d-f421-4849-886a-266c8e180df5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:24:39.397977 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-a51c8b1d-f421-4849-886a-266c8e180df5 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075705 May 26 12:24:39.398868 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 6/11] 10.222.0.39 () {64 vars in 1282 bytes} [Thu May 26 12:24:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:24:39.410961 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-f0de03bc-a89d-4aae-b46f-090ec9e00093 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:24:39.436621 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-f0de03bc-a89d-4aae-b46f-090ec9e00093 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029413 May 26 12:24:39.444265 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 6/12] 10.222.0.39 () {64 vars in 1335 bytes} [Thu May 26 12:24:39 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:24:41.771217 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-a51c8b1d-f421-4849-886a-266c8e180df5 admin admin] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:24:41.772237 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-a51c8b1d-f421-4849-886a-266c8e180df5 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 May 26 12:24:41.772651 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 7/13] 10.222.0.39 () {54 vars in 930 bytes} [Thu May 26 12:24:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:24:41.835312 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-a8b43fa7-cc34-4c62-ba7c-3dd958cff437 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "disk": 10, "os-flavor-access:is_public": true, "swap": 0, "id": "d3", "vcpus": 2, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:24:41.856603 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-a8b43fa7-cc34-4c62-ba7c-3dd958cff437 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076945 May 26 12:24:41.857550 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 7/14] 10.222.0.39 () {64 vars in 1282 bytes} [Thu May 26 12:24:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 12:24:41.874345 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-a02b5a0e-51c2-47cf-9a6c-792752dda56d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:24:41.902054 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-a02b5a0e-51c2-47cf-9a6c-792752dda56d admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032179 May 26 12:24:41.903078 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 8/15] 10.222.0.39 () {64 vars in 1335 bytes} [Thu May 26 12:24:41 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:24:44.204997 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-a8b43fa7-cc34-4c62-ba7c-3dd958cff437 admin admin] Calling method '>' {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:24:44.206701 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-a8b43fa7-cc34-4c62-ba7c-3dd958cff437 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002174 May 26 12:24:44.207574 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 8/16] 10.222.0.39 () {54 vars in 930 bytes} [Thu May 26 12:24:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:24:44.270748 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-03826475-27bc-44ea-9b0e-f37141c81e0b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 20, "name": "ds4G", "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4"}} {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:24:44.290259 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-03826475-27bc-44ea-9b0e-f37141c81e0b admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077200 May 26 12:24:44.291116 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 9/17] 10.222.0.39 () {64 vars in 1282 bytes} [Thu May 26 12:24:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:24:44.303248 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-bc3b9cd7-39b1-45aa-8d84-01e7bbb40910 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:24:44.328600 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-bc3b9cd7-39b1-45aa-8d84-01e7bbb40910 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029002 May 26 12:24:44.329227 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 9/18] 10.222.0.39 () {64 vars in 1335 bytes} [Thu May 26 12:24:44 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:24:46.621373 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-03826475-27bc-44ea-9b0e-f37141c81e0b admin admin] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:24:46.623800 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-03826475-27bc-44ea-9b0e-f37141c81e0b admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003051 May 26 12:24:46.624400 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 10/19] 10.222.0.39 () {54 vars in 930 bytes} [Thu May 26 12:24:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:24:46.688216 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-dfb556ac-295e-43fa-a88b-cd43aae3d271 admin admin] Calling method '>' {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:24:46.712328 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-dfb556ac-295e-43fa-a88b-cd43aae3d271 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081385 May 26 12:24:46.713098 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 10/20] 10.222.0.39 () {60 vars in 1291 bytes} [Thu May 26 12:24:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:24:49.041340 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-03826475-27bc-44ea-9b0e-f37141c81e0b admin admin] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:24:49.042391 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-03826475-27bc-44ea-9b0e-f37141c81e0b admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 May 26 12:24:49.042801 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 11/21] 10.222.0.39 () {54 vars in 930 bytes} [Thu May 26 12:24:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:24:49.106367 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-936b0e31-7d51-4aac-84c5-d123eefe4881 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 1}} {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:24:49.126589 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-936b0e31-7d51-4aac-84c5-d123eefe4881 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076975 May 26 12:24:49.127121 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 11/22] 10.222.0.39 () {64 vars in 1282 bytes} [Thu May 26 12:24:49 2022] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 12:24:49.140161 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-d63eea29-5511-4bcc-b984-440ff59704b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:24:49.164252 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-d63eea29-5511-4bcc-b984-440ff59704b7 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028562 May 26 12:24:49.165151 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 12/23] 10.222.0.39 () {64 vars in 1332 bytes} [Thu May 26 12:24:49 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:24:51.719754 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-936b0e31-7d51-4aac-84c5-d123eefe4881 admin admin] Calling method '>' {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:24:51.720772 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-936b0e31-7d51-4aac-84c5-d123eefe4881 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 May 26 12:24:51.721163 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 12/24] 10.222.0.39 () {54 vars in 930 bytes} [Thu May 26 12:24:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:24:51.788482 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-1a58ef1b-e844-4034-bdbe-029e5a56295a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "disk": 20}} {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:24:51.805943 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-1a58ef1b-e844-4034-bdbe-029e5a56295a admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078552 May 26 12:24:51.806499 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 13/25] 10.222.0.39 () {64 vars in 1282 bytes} [Thu May 26 12:24:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:24:51.819487 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-43583f11-6dec-45ab-b585-6dba4d37ba05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:24:51.842857 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-43583f11-6dec-45ab-b585-6dba4d37ba05 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027385 May 26 12:24:51.843430 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 13/26] 10.222.0.39 () {64 vars in 1332 bytes} [Thu May 26 12:24:51 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:24:54.132865 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-1a58ef1b-e844-4034-bdbe-029e5a56295a admin admin] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:24:54.133886 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-1a58ef1b-e844-4034-bdbe-029e5a56295a admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 May 26 12:24:54.134289 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 14/27] 10.222.0.39 () {54 vars in 930 bytes} [Thu May 26 12:24:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:24:54.193307 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-123bef2b-ef69-48b2-bf30-ce64650d4e29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "os-flavor-access:is_public": true, "ram": 4096, "disk": 40, "id": "3"}} {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:24:54.210390 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-123bef2b-ef69-48b2-bf30-ce64650d4e29 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070343 May 26 12:24:54.210955 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 14/28] 10.222.0.39 () {64 vars in 1282 bytes} [Thu May 26 12:24:54 2022] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:24:54.223392 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-e77a5ebd-6da8-426d-9f88-895da2091e44 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:24:54.247446 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-e77a5ebd-6da8-426d-9f88-895da2091e44 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027828 May 26 12:24:54.256737 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 15/29] 10.222.0.39 () {64 vars in 1332 bytes} [Thu May 26 12:24:54 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:24:56.510932 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-123bef2b-ef69-48b2-bf30-ce64650d4e29 admin admin] Calling method '>' {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:24:56.511887 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-123bef2b-ef69-48b2-bf30-ce64650d4e29 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 26 12:24:56.512397 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 15/30] 10.222.0.39 () {54 vars in 930 bytes} [Thu May 26 12:24:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:24:56.577463 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-f7895dc3-2e47-4e04-97ec-9ff47e86dbee admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 8192, "name": "m1.large", "disk": 80, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "4"}} {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:24:56.596540 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-f7895dc3-2e47-4e04-97ec-9ff47e86dbee admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077049 May 26 12:24:56.597128 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 16/31] 10.222.0.39 () {64 vars in 1282 bytes} [Thu May 26 12:24:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:24:56.610498 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-c433496d-4f4b-4cd7-bb55-967f72dedf9c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:24:56.635141 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-c433496d-4f4b-4cd7-bb55-967f72dedf9c admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028881 May 26 12:24:56.635744 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 16/32] 10.222.0.39 () {64 vars in 1332 bytes} [Thu May 26 12:24:56 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:24:58.928408 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-f7895dc3-2e47-4e04-97ec-9ff47e86dbee admin admin] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:24:58.930363 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-f7895dc3-2e47-4e04-97ec-9ff47e86dbee admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002410 May 26 12:24:58.943084 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 17/33] 10.222.0.39 () {54 vars in 930 bytes} [Thu May 26 12:24:58 2022] GET /compute/v2.1 => generated 388 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:24:59.062615 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-45a753de-935a-46a7-8916-be2ee6def277 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "id": "5", "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 8, "swap": 0, "disk": 160, "os-flavor-access:is_public": true}} {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:24:59.085262 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-45a753de-935a-46a7-8916-be2ee6def277 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.146760 May 26 12:24:59.085830 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 17/34] 10.222.0.39 () {64 vars in 1282 bytes} [Thu May 26 12:24:58 2022] POST /compute/v2.1/flavors => generated 408 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:24:59.099406 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-418ef269-f13a-4bcd-b605-f01a77b81d0d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:24:59.123004 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-418ef269-f13a-4bcd-b605-f01a77b81d0d admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028145 May 26 12:24:59.123564 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 18/35] 10.222.0.39 () {64 vars in 1332 bytes} [Thu May 26 12:24:59 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:25:23.629342 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-45a753de-935a-46a7-8916-be2ee6def277 admin admin] Calling method '>' {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:25:23.630362 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-45a753de-935a-46a7-8916-be2ee6def277 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 26 12:25:23.630793 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 18/36] 10.222.0.39 () {54 vars in 930 bytes} [Thu May 26 12:25:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:25:23.641413 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG dbcounter [-] [103044] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:23.690456 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-cee7e9c0-c0fa-4a92-91b3-fa5bbdee3b4f admin admin] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:25:23.707804 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-cee7e9c0-c0fa-4a92-91b3-fa5bbdee3b4f admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071048 May 26 12:25:23.708358 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 19/37] 10.222.0.39 () {60 vars in 1291 bytes} [Thu May 26 12:25:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:25:24.690818 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-45a753de-935a-46a7-8916-be2ee6def277 admin admin] Calling method '>' {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:25:24.691824 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-45a753de-935a-46a7-8916-be2ee6def277 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001785 May 26 12:25:24.692226 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 19/38] 10.222.0.39 () {56 vars in 1074 bytes} [Thu May 26 12:25:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:25:24.888281 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-03fb603f-7f05-493e-9069-bbc6077bfac0 admin admin] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:25:24.894646 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.wsgi [None req-03fb603f-7f05-493e-9069-bbc6077bfac0 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 12:25:24.897917 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-03fb603f-7f05-493e-9069-bbc6077bfac0 admin admin] Request method failure captured: May 26 12:25:24.897917 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 12:25:24.897917 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: Accept: application/json May 26 12:25:24.897917 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: Accept-Encoding: gzip, deflate May 26 12:25:24.897917 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: Connection: keep-alive May 26 12:25:24.897917 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: Content-Length: 0 May 26 12:25:24.897917 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: Host: 10.222.0.39 May 26 12:25:24.897917 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: Openstack-Api-Version: compute 2.90 May 26 12:25:24.897917 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: Openstack-System-Scope: None May 26 12:25:24.897917 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: User-Agent: python-novaclient May 26 12:25:24.897917 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Auth-Token: gAAAAABij3G06_hZf_thyhHLL9s_VD3Q06WezrwBt8xpcwi0hVPzntHAyDwXyG2H1c3MBitrDSYO0kM-SLvK3s9iTPYQAczMnRytKSuTcdwiyY9Kwpeq0-sjAi-4UIfMAvdWbu26s514qsamemn-MHmDdYtSrFjoX6jKCbztxJQai3EIY7ro6Po May 26 12:25:24.897917 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Domain-Id: None May 26 12:25:24.897917 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Domain-Name: None May 26 12:25:24.897917 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Identity-Status: Confirmed May 26 12:25:24.897917 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Is-Admin-Project: True May 26 12:25:24.897917 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Openstack-Nova-Api-Version: 2.90 May 26 12:25:24.897917 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Project-Domain-Id: default May 26 12:25:24.897917 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Project-Domain-Name: Default May 26 12:25:24.897917 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Project-Id: 051f7e40d662400dae586acf29916006 May 26 12:25:24.897917 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Project-Name: admin May 26 12:25:24.897917 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Role: member,admin,reader May 26 12:25:24.897917 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Roles: member,admin,reader May 26 12:25:24.899642 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/051f7e40d662400dae586acf29916006"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_051f7e40d662400dae586acf29916006", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/051f7e40d662400dae586acf29916006"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/051f7e40d662400dae586acf29916006"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:25:24.899642 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Tenant: admin May 26 12:25:24.899642 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Tenant-Id: 051f7e40d662400dae586acf29916006 May 26 12:25:24.899642 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Tenant-Name: admin May 26 12:25:24.899642 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-User: admin May 26 12:25:24.899642 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-User-Domain-Id: default May 26 12:25:24.899642 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-User-Domain-Name: Default May 26 12:25:24.899642 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-User-Id: 6cb812d57b84461b8b6450ef1b357cc1 May 26 12:25:24.899642 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-User-Name: admin May 26 12:25:24.899642 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: method: > May 26 12:25:24.899642 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: exception: Flavor 42 could not be found. May 26 12:25:24.899642 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: action_args: {'id': '42'} May 26 12:25:24.899642 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:25:24.899642 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:25:24.900593 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 12:25:24.900593 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 12:25:24.900593 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 12:25:24.900593 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 12:25:24.900593 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:25:24.900593 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:25:24.900593 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 12:25:24.900593 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 12:25:24.900593 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 12:25:24.900593 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:25:24.900593 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 12:25:24.900593 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 12:25:24.900593 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 12:25:24.900593 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi May 26 12:25:24.900593 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:25:24.900593 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi May 26 12:25:24.900593 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:25:24.900593 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:25:24.900593 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:25:24.901776 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:25:24.901776 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:25:24.901776 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:25:24.901776 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:25:24.901776 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 12:25:24.901776 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 12:25:24.901776 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 12:25:24.901776 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi May 26 12:25:24.901776 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:25:24.901776 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi May 26 12:25:24.901776 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:25:24.901776 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:25:24.901776 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:25:24.901776 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:25:24.901776 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:25:24.901776 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 12:25:24.901776 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi May 26 12:25:24.901776 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-03fb603f-7f05-493e-9069-bbc6077bfac0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:25:24.902905 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-03fb603f-7f05-493e-9069-bbc6077bfac0 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062835 May 26 12:25:24.902905 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 20/39] 10.222.0.39 () {60 vars in 1190 bytes} [Thu May 26 12:25:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 12:25:24.909107 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-106dd43a-f180-41e6-af3c-d3ccedd26d5a admin admin] Calling method '>' {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:25:24.912061 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG dbcounter [-] [103045] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:24.931540 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-106dd43a-f180-41e6-af3c-d3ccedd26d5a admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026019 May 26 12:25:24.932078 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 20/40] 10.222.0.39 () {60 vars in 1210 bytes} [Thu May 26 12:25:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:25:24.942240 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-cbec1afa-f3d1-45f6-a7b8-acc06487d0e5 admin admin] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:25:24.963681 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-cbec1afa-f3d1-45f6-a7b8-acc06487d0e5 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025591 May 26 12:25:24.964217 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 21/41] 10.222.0.39 () {60 vars in 1210 bytes} [Thu May 26 12:25:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:25:24.974066 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-59b044b9-35ec-4f7c-8693-d90f505a1f59 admin admin] Calling method '>' {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:25:24.979927 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.wsgi [None req-59b044b9-35ec-4f7c-8693-d90f505a1f59 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 12:25:24.983444 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-59b044b9-35ec-4f7c-8693-d90f505a1f59 admin admin] Request method failure captured: May 26 12:25:24.983444 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 12:25:24.983444 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: Accept: application/json May 26 12:25:24.983444 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: Accept-Encoding: gzip, deflate May 26 12:25:24.983444 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: Connection: keep-alive May 26 12:25:24.983444 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: Content-Length: 0 May 26 12:25:24.983444 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: Host: 10.222.0.39 May 26 12:25:24.983444 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: Openstack-Api-Version: compute 2.90 May 26 12:25:24.983444 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: Openstack-System-Scope: None May 26 12:25:24.983444 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: User-Agent: python-novaclient May 26 12:25:24.983444 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Auth-Token: gAAAAABij3G06_hZf_thyhHLL9s_VD3Q06WezrwBt8xpcwi0hVPzntHAyDwXyG2H1c3MBitrDSYO0kM-SLvK3s9iTPYQAczMnRytKSuTcdwiyY9Kwpeq0-sjAi-4UIfMAvdWbu26s514qsamemn-MHmDdYtSrFjoX6jKCbztxJQai3EIY7ro6Po May 26 12:25:24.983444 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Domain-Id: None May 26 12:25:24.983444 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Domain-Name: None May 26 12:25:24.983444 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Identity-Status: Confirmed May 26 12:25:24.983444 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Is-Admin-Project: True May 26 12:25:24.983444 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Openstack-Nova-Api-Version: 2.90 May 26 12:25:24.983444 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Project-Domain-Id: default May 26 12:25:24.983444 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Project-Domain-Name: Default May 26 12:25:24.983444 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Project-Id: 051f7e40d662400dae586acf29916006 May 26 12:25:24.983444 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Project-Name: admin May 26 12:25:24.983444 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Role: member,admin,reader May 26 12:25:24.983444 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Roles: member,admin,reader May 26 12:25:24.985018 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/051f7e40d662400dae586acf29916006"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_051f7e40d662400dae586acf29916006", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/051f7e40d662400dae586acf29916006"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/051f7e40d662400dae586acf29916006"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:25:24.985018 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Tenant: admin May 26 12:25:24.985018 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Tenant-Id: 051f7e40d662400dae586acf29916006 May 26 12:25:24.985018 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Tenant-Name: admin May 26 12:25:24.985018 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-User: admin May 26 12:25:24.985018 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-User-Domain-Id: default May 26 12:25:24.985018 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-User-Domain-Name: Default May 26 12:25:24.985018 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-User-Id: 6cb812d57b84461b8b6450ef1b357cc1 May 26 12:25:24.985018 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-User-Name: admin May 26 12:25:24.985018 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: method: > May 26 12:25:24.985018 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: exception: Flavor 42 could not be found. May 26 12:25:24.985018 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: action_args: {'id': '42'} May 26 12:25:24.985018 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:25:24.985018 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:25:24.985945 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 12:25:24.985945 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 12:25:24.985945 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 12:25:24.985945 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 12:25:24.985945 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:25:24.985945 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:25:24.985945 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 12:25:24.985945 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 12:25:24.985945 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 12:25:24.985945 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:25:24.985945 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 12:25:24.985945 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 12:25:24.985945 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 12:25:24.985945 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi May 26 12:25:24.985945 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:25:24.985945 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi May 26 12:25:24.985945 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:25:24.985945 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:25:24.985945 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:25:24.987014 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:25:24.987014 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:25:24.987014 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:25:24.987014 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:25:24.987014 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 12:25:24.987014 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 12:25:24.987014 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 12:25:24.987014 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi May 26 12:25:24.987014 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:25:24.987014 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi May 26 12:25:24.987014 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:25:24.987014 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:25:24.987014 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:25:24.987014 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:25:24.987014 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:25:24.987014 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 12:25:24.987014 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi May 26 12:25:24.987014 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-59b044b9-35ec-4f7c-8693-d90f505a1f59 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:25:24.988113 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-59b044b9-35ec-4f7c-8693-d90f505a1f59 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015111 May 26 12:25:24.988113 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 21/42] 10.222.0.39 () {60 vars in 1190 bytes} [Thu May 26 12:25:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 12:25:25.864828 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-cbec1afa-f3d1-45f6-a7b8-acc06487d0e5 admin admin] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:25:25.865840 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-cbec1afa-f3d1-45f6-a7b8-acc06487d0e5 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 May 26 12:25:25.866239 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 22/43] 10.222.0.39 () {56 vars in 1074 bytes} [Thu May 26 12:25:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:25:26.054771 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-9f29b28f-f724-4b53-bbca-f0995e4b0cf5 admin admin] Calling method '>' {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:25:26.060546 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.wsgi [None req-9f29b28f-f724-4b53-bbca-f0995e4b0cf5 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 12:25:26.062063 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-9f29b28f-f724-4b53-bbca-f0995e4b0cf5 admin admin] Request method failure captured: May 26 12:25:26.062063 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 12:25:26.062063 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: Accept: application/json May 26 12:25:26.062063 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: Accept-Encoding: gzip, deflate May 26 12:25:26.062063 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: Connection: keep-alive May 26 12:25:26.062063 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: Content-Length: 0 May 26 12:25:26.062063 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: Host: 10.222.0.39 May 26 12:25:26.062063 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: Openstack-Api-Version: compute 2.90 May 26 12:25:26.062063 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: Openstack-System-Scope: None May 26 12:25:26.062063 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: User-Agent: python-novaclient May 26 12:25:26.062063 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Auth-Token: gAAAAABij3G1Zt004haMIS1xDkrb5n7pc2P_2ygtUXDeGhsLr2XOfHxJ1TiHFOLKDsHR5YsPCg8hPemMoezU-_5bSYZeJB-cFDAzKhj2JithDFxy9ljkUlJgtoYAwIv8r5Vv57NiXv9tDFhP6ji7VS3nWTCYwb9XA1J4CfEvJb1zH0LQexFC0HI May 26 12:25:26.062063 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Domain-Id: None May 26 12:25:26.062063 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Domain-Name: None May 26 12:25:26.062063 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Identity-Status: Confirmed May 26 12:25:26.062063 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Is-Admin-Project: True May 26 12:25:26.062063 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Openstack-Nova-Api-Version: 2.90 May 26 12:25:26.062063 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Project-Domain-Id: default May 26 12:25:26.062063 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Project-Domain-Name: Default May 26 12:25:26.062063 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Project-Id: 051f7e40d662400dae586acf29916006 May 26 12:25:26.062063 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Project-Name: admin May 26 12:25:26.062063 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Role: member,admin,reader May 26 12:25:26.062063 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Roles: member,admin,reader May 26 12:25:26.063591 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/051f7e40d662400dae586acf29916006"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_051f7e40d662400dae586acf29916006", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/051f7e40d662400dae586acf29916006"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/051f7e40d662400dae586acf29916006"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:25:26.063591 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Tenant: admin May 26 12:25:26.063591 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Tenant-Id: 051f7e40d662400dae586acf29916006 May 26 12:25:26.063591 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Tenant-Name: admin May 26 12:25:26.063591 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-User: admin May 26 12:25:26.063591 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-User-Domain-Id: default May 26 12:25:26.063591 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-User-Domain-Name: Default May 26 12:25:26.063591 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-User-Id: 6cb812d57b84461b8b6450ef1b357cc1 May 26 12:25:26.063591 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-User-Name: admin May 26 12:25:26.063591 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: method: > May 26 12:25:26.063591 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: exception: Flavor 84 could not be found. May 26 12:25:26.063591 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: action_args: {'id': '84'} May 26 12:25:26.063591 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:25:26.063591 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:25:26.064568 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 12:25:26.064568 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 12:25:26.064568 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 12:25:26.064568 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 12:25:26.064568 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:25:26.064568 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:25:26.064568 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 12:25:26.064568 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 12:25:26.064568 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 12:25:26.064568 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:25:26.064568 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 12:25:26.064568 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 12:25:26.064568 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 12:25:26.064568 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi May 26 12:25:26.064568 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:25:26.064568 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi May 26 12:25:26.064568 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:25:26.064568 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:25:26.064568 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:25:26.066016 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:25:26.066016 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:25:26.066016 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:25:26.066016 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:25:26.066016 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 12:25:26.066016 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 12:25:26.066016 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 12:25:26.066016 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi May 26 12:25:26.066016 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:25:26.066016 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi May 26 12:25:26.066016 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:25:26.066016 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:25:26.066016 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:25:26.066016 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:25:26.066016 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:25:26.066016 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 12:25:26.066016 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi May 26 12:25:26.066016 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-9f29b28f-f724-4b53-bbca-f0995e4b0cf5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:25:26.068012 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-9f29b28f-f724-4b53-bbca-f0995e4b0cf5 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062102 May 26 12:25:26.068012 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 22/44] 10.222.0.39 () {60 vars in 1190 bytes} [Thu May 26 12:25:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 12:25:26.073885 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-924215e0-9f3c-4773-a6f2-99cf9abb77af admin admin] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:25:26.089396 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-924215e0-9f3c-4773-a6f2-99cf9abb77af admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019110 May 26 12:25:26.089940 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 23/45] 10.222.0.39 () {60 vars in 1210 bytes} [Thu May 26 12:25:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:25:26.099553 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-9b785390-ca42-4ccb-a7a8-059b1d83b1e5 admin admin] Calling method '>' {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:25:26.116033 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-9b785390-ca42-4ccb-a7a8-059b1d83b1e5 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020350 May 26 12:25:26.116573 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 23/46] 10.222.0.39 () {60 vars in 1210 bytes} [Thu May 26 12:25:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:25:26.126291 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-6dd1b7ea-dcd7-4083-ae9f-c4604b43894c admin admin] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:25:26.132607 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.wsgi [None req-6dd1b7ea-dcd7-4083-ae9f-c4604b43894c admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 12:25:26.135047 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-6dd1b7ea-dcd7-4083-ae9f-c4604b43894c admin admin] Request method failure captured: May 26 12:25:26.135047 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 12:25:26.135047 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: Accept: application/json May 26 12:25:26.135047 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: Accept-Encoding: gzip, deflate May 26 12:25:26.135047 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: Connection: keep-alive May 26 12:25:26.135047 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: Content-Length: 0 May 26 12:25:26.135047 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: Host: 10.222.0.39 May 26 12:25:26.135047 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: Openstack-Api-Version: compute 2.90 May 26 12:25:26.135047 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: Openstack-System-Scope: None May 26 12:25:26.135047 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: User-Agent: python-novaclient May 26 12:25:26.135047 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Auth-Token: gAAAAABij3G1Zt004haMIS1xDkrb5n7pc2P_2ygtUXDeGhsLr2XOfHxJ1TiHFOLKDsHR5YsPCg8hPemMoezU-_5bSYZeJB-cFDAzKhj2JithDFxy9ljkUlJgtoYAwIv8r5Vv57NiXv9tDFhP6ji7VS3nWTCYwb9XA1J4CfEvJb1zH0LQexFC0HI May 26 12:25:26.135047 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Domain-Id: None May 26 12:25:26.135047 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Domain-Name: None May 26 12:25:26.135047 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Identity-Status: Confirmed May 26 12:25:26.135047 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Is-Admin-Project: True May 26 12:25:26.135047 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Openstack-Nova-Api-Version: 2.90 May 26 12:25:26.135047 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Project-Domain-Id: default May 26 12:25:26.135047 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Project-Domain-Name: Default May 26 12:25:26.135047 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Project-Id: 051f7e40d662400dae586acf29916006 May 26 12:25:26.135047 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Project-Name: admin May 26 12:25:26.135047 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Role: member,admin,reader May 26 12:25:26.135047 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Roles: member,admin,reader May 26 12:25:26.136566 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/051f7e40d662400dae586acf29916006"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_051f7e40d662400dae586acf29916006", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/051f7e40d662400dae586acf29916006"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/051f7e40d662400dae586acf29916006"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:25:26.136566 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Tenant: admin May 26 12:25:26.136566 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Tenant-Id: 051f7e40d662400dae586acf29916006 May 26 12:25:26.136566 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Tenant-Name: admin May 26 12:25:26.136566 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-User: admin May 26 12:25:26.136566 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-User-Domain-Id: default May 26 12:25:26.136566 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-User-Domain-Name: Default May 26 12:25:26.136566 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-User-Id: 6cb812d57b84461b8b6450ef1b357cc1 May 26 12:25:26.136566 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-User-Name: admin May 26 12:25:26.136566 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: method: > May 26 12:25:26.136566 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: exception: Flavor 84 could not be found. May 26 12:25:26.136566 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: action_args: {'id': '84'} May 26 12:25:26.136566 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:25:26.136566 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:25:26.137428 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 12:25:26.137428 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 12:25:26.137428 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 12:25:26.137428 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 12:25:26.137428 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:25:26.137428 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:25:26.137428 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 12:25:26.137428 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 12:25:26.137428 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 12:25:26.137428 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:25:26.137428 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 12:25:26.137428 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 12:25:26.137428 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 12:25:26.137428 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi May 26 12:25:26.137428 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:25:26.137428 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi May 26 12:25:26.137428 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:25:26.137428 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:25:26.137428 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:25:26.138945 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:25:26.138945 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:25:26.138945 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:25:26.138945 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:25:26.138945 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 12:25:26.138945 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 12:25:26.138945 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 12:25:26.138945 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi May 26 12:25:26.138945 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:25:26.138945 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi May 26 12:25:26.138945 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:25:26.138945 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:25:26.138945 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:25:26.138945 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:25:26.138945 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:25:26.138945 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 12:25:26.138945 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi May 26 12:25:26.138945 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-6dd1b7ea-dcd7-4083-ae9f-c4604b43894c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:25:26.140402 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-6dd1b7ea-dcd7-4083-ae9f-c4604b43894c admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.014399 May 26 12:25:26.140402 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 24/47] 10.222.0.39 () {60 vars in 1190 bytes} [Thu May 26 12:25:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 26 12:25:27.007977 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-9b785390-ca42-4ccb-a7a8-059b1d83b1e5 admin admin] Calling method '>' {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:25:27.009017 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-9b785390-ca42-4ccb-a7a8-059b1d83b1e5 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 May 26 12:25:27.009429 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 24/48] 10.222.0.39 () {56 vars in 1074 bytes} [Thu May 26 12:25:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:25:27.198013 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-108e279b-844a-4e6c-85cf-ee050c87cfee admin admin] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:25:27.203741 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.wsgi [None req-108e279b-844a-4e6c-85cf-ee050c87cfee admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 12:25:27.205287 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-108e279b-844a-4e6c-85cf-ee050c87cfee admin admin] Request method failure captured: May 26 12:25:27.205287 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 12:25:27.205287 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: Accept: application/json May 26 12:25:27.205287 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: Accept-Encoding: gzip, deflate May 26 12:25:27.205287 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: Connection: keep-alive May 26 12:25:27.205287 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: Content-Length: 0 May 26 12:25:27.205287 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: Host: 10.222.0.39 May 26 12:25:27.205287 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: Openstack-Api-Version: compute 2.90 May 26 12:25:27.205287 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: Openstack-System-Scope: None May 26 12:25:27.205287 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: User-Agent: python-novaclient May 26 12:25:27.205287 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Auth-Token: gAAAAABij3G2xtMLM0KIRm9EOErq_UAAxhJ7sTz4FsHf7JsxSGz9D0IpoajY2BnYB2TQyJp2QB0qreVdhI5MtfKpPgkvavidy8xp5CRE2fGi1P-9ywHyEr35b6pMERWiqHTYTsxVx75SWs8RltboAWhPqqdqw-G-G_QiW9PHMI1UoU3RofEg1ZA May 26 12:25:27.205287 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Domain-Id: None May 26 12:25:27.205287 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Domain-Name: None May 26 12:25:27.205287 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Identity-Status: Confirmed May 26 12:25:27.205287 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Is-Admin-Project: True May 26 12:25:27.205287 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Openstack-Nova-Api-Version: 2.90 May 26 12:25:27.205287 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Project-Domain-Id: default May 26 12:25:27.205287 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Project-Domain-Name: Default May 26 12:25:27.205287 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Project-Id: 051f7e40d662400dae586acf29916006 May 26 12:25:27.205287 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Project-Name: admin May 26 12:25:27.205287 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Role: member,admin,reader May 26 12:25:27.205287 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Roles: member,admin,reader May 26 12:25:27.206870 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/051f7e40d662400dae586acf29916006"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_051f7e40d662400dae586acf29916006", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/051f7e40d662400dae586acf29916006"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/051f7e40d662400dae586acf29916006"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:25:27.206870 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Tenant: admin May 26 12:25:27.206870 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Tenant-Id: 051f7e40d662400dae586acf29916006 May 26 12:25:27.206870 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-Tenant-Name: admin May 26 12:25:27.206870 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-User: admin May 26 12:25:27.206870 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-User-Domain-Id: default May 26 12:25:27.206870 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-User-Domain-Name: Default May 26 12:25:27.206870 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-User-Id: 6cb812d57b84461b8b6450ef1b357cc1 May 26 12:25:27.206870 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: X-User-Name: admin May 26 12:25:27.206870 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: method: > May 26 12:25:27.206870 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: exception: Flavor 451 could not be found. May 26 12:25:27.206870 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: action_args: {'id': '451'} May 26 12:25:27.206870 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:25:27.206870 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:25:27.207988 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 12:25:27.207988 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 12:25:27.207988 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 12:25:27.207988 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 12:25:27.207988 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:25:27.207988 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:25:27.207988 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 12:25:27.207988 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 12:25:27.207988 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 12:25:27.207988 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:25:27.207988 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 12:25:27.207988 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 12:25:27.207988 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 12:25:27.207988 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi May 26 12:25:27.207988 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:25:27.207988 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi May 26 12:25:27.207988 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:25:27.207988 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:25:27.207988 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:25:27.209457 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:25:27.209457 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:25:27.209457 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:25:27.209457 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:25:27.209457 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 12:25:27.209457 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 12:25:27.209457 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 12:25:27.209457 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi May 26 12:25:27.209457 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:25:27.209457 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi May 26 12:25:27.209457 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:25:27.209457 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:25:27.209457 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:25:27.209457 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:25:27.209457 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:25:27.209457 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 12:25:27.209457 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: ERROR nova.api.openstack.wsgi May 26 12:25:27.209457 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-108e279b-844a-4e6c-85cf-ee050c87cfee admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:25:27.210940 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-108e279b-844a-4e6c-85cf-ee050c87cfee admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060633 May 26 12:25:27.210940 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 25/49] 10.222.0.39 () {60 vars in 1193 bytes} [Thu May 26 12:25:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 12:25:27.216444 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-8356740b-5de9-4be9-99e2-9c7560035e21 admin admin] Calling method '>' {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:25:27.230540 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-8356740b-5de9-4be9-99e2-9c7560035e21 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017631 May 26 12:25:27.231112 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 25/50] 10.222.0.39 () {60 vars in 1210 bytes} [Thu May 26 12:25:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:25:27.241325 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-90cf682e-b53a-4a1c-afe2-41e78f2e4b36 admin admin] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:25:27.254874 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-90cf682e-b53a-4a1c-afe2-41e78f2e4b36 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017870 May 26 12:25:27.255405 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 26/51] 10.222.0.39 () {60 vars in 1210 bytes} [Thu May 26 12:25:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:25:27.264351 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-f021b297-d906-40ea-a369-8d3eda1b3885 admin admin] Calling method '>' {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:25:27.269732 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.wsgi [None req-f021b297-d906-40ea-a369-8d3eda1b3885 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 12:25:27.271229 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-f021b297-d906-40ea-a369-8d3eda1b3885 admin admin] Request method failure captured: May 26 12:25:27.271229 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 12:25:27.271229 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: Accept: application/json May 26 12:25:27.271229 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: Accept-Encoding: gzip, deflate May 26 12:25:27.271229 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: Connection: keep-alive May 26 12:25:27.271229 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: Content-Length: 0 May 26 12:25:27.271229 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: Host: 10.222.0.39 May 26 12:25:27.271229 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: Openstack-Api-Version: compute 2.90 May 26 12:25:27.271229 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: Openstack-System-Scope: None May 26 12:25:27.271229 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: User-Agent: python-novaclient May 26 12:25:27.271229 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Auth-Token: gAAAAABij3G2xtMLM0KIRm9EOErq_UAAxhJ7sTz4FsHf7JsxSGz9D0IpoajY2BnYB2TQyJp2QB0qreVdhI5MtfKpPgkvavidy8xp5CRE2fGi1P-9ywHyEr35b6pMERWiqHTYTsxVx75SWs8RltboAWhPqqdqw-G-G_QiW9PHMI1UoU3RofEg1ZA May 26 12:25:27.271229 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Domain-Id: None May 26 12:25:27.271229 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Domain-Name: None May 26 12:25:27.271229 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Identity-Status: Confirmed May 26 12:25:27.271229 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Is-Admin-Project: True May 26 12:25:27.271229 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Openstack-Nova-Api-Version: 2.90 May 26 12:25:27.271229 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Project-Domain-Id: default May 26 12:25:27.271229 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Project-Domain-Name: Default May 26 12:25:27.271229 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Project-Id: 051f7e40d662400dae586acf29916006 May 26 12:25:27.271229 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Project-Name: admin May 26 12:25:27.271229 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Role: member,admin,reader May 26 12:25:27.271229 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Roles: member,admin,reader May 26 12:25:27.272856 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/051f7e40d662400dae586acf29916006"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_051f7e40d662400dae586acf29916006", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/051f7e40d662400dae586acf29916006"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/051f7e40d662400dae586acf29916006"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:25:27.272856 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Tenant: admin May 26 12:25:27.272856 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Tenant-Id: 051f7e40d662400dae586acf29916006 May 26 12:25:27.272856 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-Tenant-Name: admin May 26 12:25:27.272856 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-User: admin May 26 12:25:27.272856 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-User-Domain-Id: default May 26 12:25:27.272856 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-User-Domain-Name: Default May 26 12:25:27.272856 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-User-Id: 6cb812d57b84461b8b6450ef1b357cc1 May 26 12:25:27.272856 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: X-User-Name: admin May 26 12:25:27.272856 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: method: > May 26 12:25:27.272856 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: exception: Flavor 451 could not be found. May 26 12:25:27.272856 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: action_args: {'id': '451'} May 26 12:25:27.272856 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:25:27.272856 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:25:27.273824 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 12:25:27.273824 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 12:25:27.273824 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 12:25:27.273824 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 12:25:27.273824 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:25:27.273824 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:25:27.273824 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 12:25:27.273824 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 12:25:27.273824 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 12:25:27.273824 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:25:27.273824 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 12:25:27.273824 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 12:25:27.273824 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 12:25:27.273824 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi May 26 12:25:27.273824 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:25:27.273824 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi May 26 12:25:27.273824 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:25:27.273824 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:25:27.273824 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:25:27.275162 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:25:27.275162 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:25:27.275162 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:25:27.275162 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:25:27.275162 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 12:25:27.275162 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 12:25:27.275162 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 12:25:27.275162 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi May 26 12:25:27.275162 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:25:27.275162 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi May 26 12:25:27.275162 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:25:27.275162 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:25:27.275162 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:25:27.275162 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:25:27.275162 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:25:27.275162 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 12:25:27.275162 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: ERROR nova.api.openstack.wsgi May 26 12:25:27.275162 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-f021b297-d906-40ea-a369-8d3eda1b3885 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:25:27.276392 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-f021b297-d906-40ea-a369-8d3eda1b3885 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011758 May 26 12:25:27.276392 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 26/52] 10.222.0.39 () {60 vars in 1193 bytes} [Thu May 26 12:25:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 12:25:28.158505 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-90cf682e-b53a-4a1c-afe2-41e78f2e4b36 admin admin] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:25:28.159504 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-90cf682e-b53a-4a1c-afe2-41e78f2e4b36 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 26 12:25:28.159897 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 27/53] 10.222.0.39 () {56 vars in 1074 bytes} [Thu May 26 12:25:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:25:28.347881 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-1183a8b6-7b74-4066-aeed-45bca38473e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:25:28.366280 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-1183a8b6-7b74-4066-aeed-45bca38473e1 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069885 May 26 12:25:28.366818 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 27/54] 10.222.0.39 () {64 vars in 1235 bytes} [Thu May 26 12:25:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:25:29.231738 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-90cf682e-b53a-4a1c-afe2-41e78f2e4b36 admin admin] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:25:29.233016 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-90cf682e-b53a-4a1c-afe2-41e78f2e4b36 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001663 May 26 12:25:29.233416 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 28/55] 10.222.0.39 () {56 vars in 1074 bytes} [Thu May 26 12:25:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:25:29.420259 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-9b29f7f0-2476-4b68-bfff-89a6f8fb8f7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:25:29.437488 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-9b29f7f0-2476-4b68-bfff-89a6f8fb8f7a admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068810 May 26 12:25:29.438040 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 28/56] 10.222.0.39 () {64 vars in 1235 bytes} [Thu May 26 12:25:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 12:25:30.310233 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-90cf682e-b53a-4a1c-afe2-41e78f2e4b36 admin admin] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:25:30.311255 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-90cf682e-b53a-4a1c-afe2-41e78f2e4b36 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 26 12:25:30.311652 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 29/57] 10.222.0.39 () {56 vars in 1074 bytes} [Thu May 26 12:25:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:25:30.500802 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-aaeab66c-f712-40d3-946a-a138652913c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:25:30.517474 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-aaeab66c-f712-40d3-946a-a138652913c8 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067958 May 26 12:25:30.518010 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 29/58] 10.222.0.39 () {64 vars in 1235 bytes} [Thu May 26 12:25:30 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:25:31.382986 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-90cf682e-b53a-4a1c-afe2-41e78f2e4b36 admin admin] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:25:31.383994 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-90cf682e-b53a-4a1c-afe2-41e78f2e4b36 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 May 26 12:25:31.384394 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 30/59] 10.222.0.39 () {56 vars in 1074 bytes} [Thu May 26 12:25:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:25:31.580360 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-1ccffa0f-e4e4-4194-9ac0-0784bdb31219 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:25:31.597559 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-1ccffa0f-e4e4-4194-9ac0-0784bdb31219 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.075453 May 26 12:25:31.598190 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 30/60] 10.222.0.39 () {64 vars in 1235 bytes} [Thu May 26 12:25:31 2022] POST /compute/v2.1/flavors => generated 409 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 12:25:32.466264 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-90cf682e-b53a-4a1c-afe2-41e78f2e4b36 admin admin] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:25:32.467265 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-90cf682e-b53a-4a1c-afe2-41e78f2e4b36 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 26 12:25:32.467662 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 31/61] 10.222.0.39 () {56 vars in 1074 bytes} [Thu May 26 12:25:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:25:32.660175 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-cde8d7c8-27b9-426a-a629-f587d4bd67a3 admin admin] Calling method '>' {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:25:32.680404 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-cde8d7c8-27b9-426a-a629-f587d4bd67a3 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072009 May 26 12:25:32.681006 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 31/62] 10.222.0.39 () {60 vars in 1202 bytes} [Thu May 26 12:25:32 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:26:34.844813 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-90cf682e-b53a-4a1c-afe2-41e78f2e4b36 admin admin] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:26:34.845822 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-90cf682e-b53a-4a1c-afe2-41e78f2e4b36 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 26 12:26:34.846253 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 32/63] 10.222.0.39 () {54 vars in 930 bytes} [Thu May 26 12:26:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:26:34.853826 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG dbcounter [-] [103045] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:34.906630 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-ccd0f793-3380-4f38-a91d-34f8c38f6654 admin admin] Calling method '>' {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:26:34.926137 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-ccd0f793-3380-4f38-a91d-34f8c38f6654 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073816 May 26 12:26:34.926683 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 32/64] 10.222.0.39 () {60 vars in 1291 bytes} [Thu May 26 12:26:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:26:34.947542 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG dbcounter [-] [103044] Writing DB stats nova_api:SELECT=14 {{(pid=103044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:34.951558 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-ffb34af4-534e-4f73-89e3-97875ab6ec6b admin admin] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:26:34.959203 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-ffb34af4-534e-4f73-89e3-97875ab6ec6b admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013096 May 26 12:26:34.959721 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 33/65] 10.222.0.39 () {60 vars in 1282 bytes} [Thu May 26 12:26:34 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:26:34.971701 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-f1ff7eb3-5325-419b-870f-3b29a7c91e7a admin admin] Calling method '>' {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:26:34.979312 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-f1ff7eb3-5325-419b-870f-3b29a7c91e7a admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011153 May 26 12:26:34.979831 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 33/66] 10.222.0.39 () {60 vars in 1285 bytes} [Thu May 26 12:26:34 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:26:34.991894 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-fe8aabdc-b6d9-4e22-9f93-9d9a73d9b926 admin admin] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:26:34.999380 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-fe8aabdc-b6d9-4e22-9f93-9d9a73d9b926 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011207 May 26 12:26:34.999895 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 34/67] 10.222.0.39 () {60 vars in 1285 bytes} [Thu May 26 12:26:34 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:26:35.012001 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-a5c7ceec-c5bf-4ef5-bfa7-75b0e9cba502 admin admin] Calling method '>' {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:26:35.019494 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-a5c7ceec-c5bf-4ef5-bfa7-75b0e9cba502 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011131 May 26 12:26:35.020009 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 34/68] 10.222.0.39 () {60 vars in 1282 bytes} [Thu May 26 12:26:35 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:30:17.252282 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-fe8aabdc-b6d9-4e22-9f93-9d9a73d9b926 admin admin] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:30:17.253475 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-fe8aabdc-b6d9-4e22-9f93-9d9a73d9b926 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001652 May 26 12:30:17.253878 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 35/69] 10.222.0.39 () {56 vars in 1074 bytes} [Thu May 26 12:30:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:30:17.410147 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG dbcounter [-] [103045] Writing DB stats nova_api:SELECT=6 {{(pid=103045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:30:17.523849 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-cb53653e-ced0-41ec-ba77-3d77f13e5d90 admin admin] Calling method '>' {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:30:17.525043 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:30:17.525043 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: warnings.warn(msg) May 26 12:30:17.526283 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG oslo_concurrency.lockutils [None req-cb53653e-ced0-41ec-ba77-3d77f13e5d90 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:30:17.526743 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG oslo_concurrency.lockutils [None req-cb53653e-ced0-41ec-ba77-3d77f13e5d90 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:30:17.527812 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG oslo_concurrency.lockutils [None req-cb53653e-ced0-41ec-ba77-3d77f13e5d90 admin admin] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:30:17.528241 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG oslo_concurrency.lockutils [None req-cb53653e-ced0-41ec-ba77-3d77f13e5d90 admin admin] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:30:17.562401 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-cb53653e-ced0-41ec-ba77-3d77f13e5d90 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.153789 May 26 12:30:17.562947 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 35/70] 10.222.0.39 () {60 vars in 1193 bytes} [Thu May 26 12:30:17 2022] GET /compute/v2.1/os-services => generated 794 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 12:30:18.441155 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-fe8aabdc-b6d9-4e22-9f93-9d9a73d9b926 admin admin] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:30:18.442224 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-fe8aabdc-b6d9-4e22-9f93-9d9a73d9b926 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 May 26 12:30:18.442693 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 36/71] 10.222.0.39 () {56 vars in 1074 bytes} [Thu May 26 12:30:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:30:18.641389 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-c14a9e48-1d39-4fd6-a5a2-b524f928eef3 admin admin] Calling method '>' {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:30:18.642557 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:30:18.642557 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: warnings.warn(msg) May 26 12:30:18.643766 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG oslo_concurrency.lockutils [None req-c14a9e48-1d39-4fd6-a5a2-b524f928eef3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:30:18.644205 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG oslo_concurrency.lockutils [None req-c14a9e48-1d39-4fd6-a5a2-b524f928eef3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:30:18.645011 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG oslo_concurrency.lockutils [None req-c14a9e48-1d39-4fd6-a5a2-b524f928eef3 admin admin] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:30:18.645436 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG oslo_concurrency.lockutils [None req-c14a9e48-1d39-4fd6-a5a2-b524f928eef3 admin admin] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:30:18.665297 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-c14a9e48-1d39-4fd6-a5a2-b524f928eef3 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076073 May 26 12:30:18.665944 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 36/72] 10.222.0.39 () {60 vars in 1193 bytes} [Thu May 26 12:30:18 2022] GET /compute/v2.1/os-services => generated 794 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:30:29.965583 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-fe8aabdc-b6d9-4e22-9f93-9d9a73d9b926 admin admin] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:30:29.966595 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-fe8aabdc-b6d9-4e22-9f93-9d9a73d9b926 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 May 26 12:30:29.967003 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 37/73] 10.222.0.39 () {56 vars in 1074 bytes} [Thu May 26 12:30:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:30:30.112341 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG dbcounter [-] [103045] Writing DB stats nova_cell0:SELECT=4 {{(pid=103045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:30:30.113572 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG dbcounter [-] [103045] Writing DB stats nova_cell1:SELECT=4 {{(pid=103045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:30:30.114174 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG dbcounter [-] [103045] Writing DB stats nova_api:SELECT=8 {{(pid=103045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:30:30.165074 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-bb76d3d7-f317-4391-a356-7492c5ccdd7a admin admin] Calling method '>' {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:30:30.166303 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:30:30.166303 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: warnings.warn(msg) May 26 12:30:30.167482 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG oslo_concurrency.lockutils [None req-bb76d3d7-f317-4391-a356-7492c5ccdd7a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:30:30.167921 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG oslo_concurrency.lockutils [None req-bb76d3d7-f317-4391-a356-7492c5ccdd7a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:30:30.168697 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG oslo_concurrency.lockutils [None req-bb76d3d7-f317-4391-a356-7492c5ccdd7a admin admin] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:30:30.169150 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG oslo_concurrency.lockutils [None req-bb76d3d7-f317-4391-a356-7492c5ccdd7a admin admin] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:30:30.194068 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-bb76d3d7-f317-4391-a356-7492c5ccdd7a admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.086120 May 26 12:30:30.194622 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 37/74] 10.222.0.39 () {60 vars in 1193 bytes} [Thu May 26 12:30:30 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:30:31.072661 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: DEBUG nova.api.openstack.wsgi [None req-fe8aabdc-b6d9-4e22-9f93-9d9a73d9b926 admin admin] Calling method '>' {{(pid=103044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:30:31.073802 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: INFO nova.api.openstack.requestlog [None req-fe8aabdc-b6d9-4e22-9f93-9d9a73d9b926 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 May 26 12:30:31.074227 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: [pid: 103044|app: 0|req: 38/75] 10.222.0.39 () {56 vars in 1074 bytes} [Thu May 26 12:30:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:30:31.267326 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG nova.api.openstack.wsgi [None req-56686791-db6a-4d08-bbad-2e9934edfd63 admin admin] Calling method '>' {{(pid=103045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:30:31.268904 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:30:31.268904 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: warnings.warn(msg) May 26 12:30:31.270269 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG oslo_concurrency.lockutils [None req-56686791-db6a-4d08-bbad-2e9934edfd63 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:30:31.270703 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG oslo_concurrency.lockutils [None req-56686791-db6a-4d08-bbad-2e9934edfd63 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:30:31.271477 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG oslo_concurrency.lockutils [None req-56686791-db6a-4d08-bbad-2e9934edfd63 admin admin] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:30:31.271900 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: DEBUG oslo_concurrency.lockutils [None req-56686791-db6a-4d08-bbad-2e9934edfd63 admin admin] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:30:31.293695 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: INFO nova.api.openstack.requestlog [None req-56686791-db6a-4d08-bbad-2e9934edfd63 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.080754 May 26 12:30:31.294182 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: [pid: 103045|app: 0|req: 38/76] 10.222.0.39 () {60 vars in 1193 bytes} [Thu May 26 12:30:31 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:31:33.145419 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: Thu May 26 12:31:33 2022 - graceful shutdown triggered... May 26 12:31:33.145933 dv-cinder-815145-10-iscsi devstack@n-api.service[103044]: Gracefully killing worker 1 (pid: 103044)... May 26 12:31:33.146307 dv-cinder-815145-10-iscsi devstack@n-api.service[103045]: Gracefully killing worker 2 (pid: 103045)... May 26 12:31:33.146927 dv-cinder-815145-10-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 26 12:31:34.146334 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: worker 1 buried after 1 seconds May 26 12:31:34.146334 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: worker 2 buried after 1 seconds May 26 12:31:34.146334 dv-cinder-815145-10-iscsi devstack@n-api.service[103043]: goodbye to uWSGI. May 26 12:31:34.147812 dv-cinder-815145-10-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 26 12:31:34.148395 dv-cinder-815145-10-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 26 12:31:34.151036 dv-cinder-815145-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 12:31:34.164186 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 12:31:34.189021 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 12:31:34 2022] *** May 26 12:31:34.189021 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 12:31:34.189021 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 12:31:34.189021 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: nodename: dv-cinder-815145-10-iscsi May 26 12:31:34.189021 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: machine: x86_64 May 26 12:31:34.189021 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: clock source: unix May 26 12:31:34.189021 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: pcre jit disabled May 26 12:31:34.189021 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: detected number of CPU cores: 4 May 26 12:31:34.189021 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: current working directory: / May 26 12:31:34.189688 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: detected binary path: /usr/bin/uwsgi-core May 26 12:31:34.189688 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: your processes number limit is 47680 May 26 12:31:34.189688 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: your memory page size is 4096 bytes May 26 12:31:34.189688 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: detected max file descriptor number: 2048 May 26 12:31:34.189688 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: lock engine: pthread robust mutexes May 26 12:31:34.189688 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: thunder lock: enabled May 26 12:31:34.189688 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 12:31:34.189688 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 12:31:34.240351 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: Python main interpreter initialized at 0x562c88c6f9c0 May 26 12:31:34.240351 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: python threads support enabled May 26 12:31:34.240351 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: your server socket listen backlog is limited to 100 connections May 26 12:31:34.240351 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: your mercy for graceful operations on workers is 90 seconds May 26 12:31:34.240837 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: mapped 403077 bytes (393 KB) for 2 cores May 26 12:31:34.240837 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: *** Operational MODE: preforking *** May 26 12:31:34.241077 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: *** uWSGI is running in multiple interpreter mode *** May 26 12:31:34.241077 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: spawned uWSGI master process (pid: 124114) May 26 12:31:34.241287 dv-cinder-815145-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 12:31:34.242427 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: spawned uWSGI worker 1 (pid: 124133, cores: 1) May 26 12:31:34.242427 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: spawned uWSGI worker 2 (pid: 124134, cores: 1) May 26 12:31:34.242427 dv-cinder-815145-10-iscsi devstack@n-api.service[124114]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 12:31:35.450243 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 12:31:35.454800 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 12:31:36.245778 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:31:36.245778 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: from cryptography.utils import int_from_bytes May 26 12:31:36.246162 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:31:36.246162 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: from cryptography.utils import int_from_bytes May 26 12:31:36.246353 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:31:36.246353 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: from cryptography.utils import int_from_bytes May 26 12:31:36.246694 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:31:36.246694 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: from cryptography.utils import int_from_bytes May 26 12:31:38.690364 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 12:31:38.690964 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 12:31:38.691049 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 12:31:38.691049 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 12:31:38.691495 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 12:31:38.691582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 12:31:38.691668 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 12:31:38.691753 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 12:31:38.692090 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 12:31:38.692090 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 12:31:38.692271 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.692444 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.692549 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.692793 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.692911 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.693136 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.693251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.693460 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.693566 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.693792 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.693898 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.694105 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.694216 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.694436 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.694541 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.694767 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.694879 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.695047 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.695158 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.695347 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.695445 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.695670 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.695779 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815145-10-iscsi {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.695996 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.696162 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815145-10-iscsi {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.696318 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.696476 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.696627 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.696821 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.697395 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.697564 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.697738 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.697892 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.698037 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.698711 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.698891 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.699075 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.699075 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.699364 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.699537 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.699792 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.701716 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.701716 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.702145 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.702369 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.702588 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.702799 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.703023 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.703244 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.703460 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.703699 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.703907 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.704114 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.704323 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.704539 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.704773 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.705005 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.705213 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.705435 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815145-10-iscsi {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.705652 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.705881 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.706070 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.706255 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.706506 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815145-10-iscsi {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.706669 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.706875 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.707033 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.707186 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.707341 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.707578 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.707737 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.707890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.708045 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.708196 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.708347 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.708501 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.708653 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.708876 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.709035 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.709188 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.709340 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.709491 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.709643 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.709870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.710023 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.710175 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.710319 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.710461 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.710622 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.710780 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.710933 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.711087 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.711241 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.711840 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.712017 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.712172 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.712322 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.712476 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.712639 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.712846 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.713014 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.713179 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.713324 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.713474 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.713626 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.713775 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.714512 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.714880 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.715041 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.715205 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.715429 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.715589 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.715748 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.715895 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.716038 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.716187 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.716344 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.716494 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.716644 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.716803 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.716951 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.717102 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.717253 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.717405 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.717553 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.717702 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.717849 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.717990 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.718143 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.718283 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.718424 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.718573 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.718721 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.718874 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.718874 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.719156 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.719309 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.719453 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.719602 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.719763 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.719905 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.720051 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.720205 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.720356 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.720497 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.720647 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.720848 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.720992 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.721141 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.721300 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.721448 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.721602 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.721748 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.721991 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.722148 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.722301 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.722448 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.722597 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.722745 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.722883 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.723034 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.723182 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.723342 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.723489 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.723636 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.723788 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.723932 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.724080 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.724232 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.724378 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.724519 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.724659 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.724822 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.724972 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.725121 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.725222 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.725308 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.725400 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.725493 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.725578 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.725670 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.725755 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.725856 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.725952 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.726037 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.726135 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.726221 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.726312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.726396 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.726480 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.726571 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.726669 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.726761 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.726853 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.726946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.727038 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.727128 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.727226 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.727318 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.727403 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.727486 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.727569 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.727652 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.727748 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.727840 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.727933 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.728025 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.728110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.728207 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.728305 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.728391 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.728475 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.728566 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.728651 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.728772 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.728868 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.728952 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.729050 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.729135 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.729226 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.729317 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.729446 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.729543 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.729636 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.729721 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.729812 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.730002 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.730002 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.730177 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.730322 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.730411 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.730495 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.730588 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.730719 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.730896 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.731030 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.731227 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.731355 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.731539 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.731663 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.731855 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.731961 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.732185 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.732331 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.732472 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.732563 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.732807 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.732945 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.733126 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.733237 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.733440 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.733534 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.733753 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.733896 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.734067 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.734173 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.734379 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.734472 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.734689 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.734788 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.734997 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.735168 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.735702 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.735822 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.735822 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.735995 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.736081 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.736177 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.736269 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.736355 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.736561 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.736645 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.736914 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.737299 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.737644 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.737808 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:31:38.737996 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.738168 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.738329 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.738482 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.738633 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.738779 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.738963 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.739106 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.739283 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.739436 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.739620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.739770 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.739946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.740122 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.740275 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.740427 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.740572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.740852 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.741017 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.741178 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.741323 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.741466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.741621 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.741764 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.741913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.742071 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.742335 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.742496 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.742656 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.742809 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.742961 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.743117 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.743275 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.743427 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.743598 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.743824 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.744017 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.744166 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.744335 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.744495 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.744634 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.744790 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.744877 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.744950 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.745128 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.745326 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.745512 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.745656 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.745799 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.745997 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.746142 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.746355 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.746543 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.746691 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.746851 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.747007 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.747150 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.747329 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.747476 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.747651 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.747789 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.748012 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.748106 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.748276 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.748463 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.748602 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.748867 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.749026 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.749177 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.749327 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.749481 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.749615 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.749863 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.749968 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.750198 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.750289 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.750515 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.750612 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.750833 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.750924 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.751153 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.751254 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.751479 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.751578 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.751799 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.751899 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.752122 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.752213 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.752438 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.752529 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.752778 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.752872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.753101 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.753246 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.753414 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.753559 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.753729 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.753824 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.754042 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.754135 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.754357 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.754462 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.754665 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.754764 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.754981 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.755072 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.755297 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.755444 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.755618 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.755717 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.755956 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.756096 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.756268 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.756368 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.756587 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.756678 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.756936 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.757074 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.757249 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.757361 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.757977 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.758059 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.758143 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.758236 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.758310 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.758390 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.758468 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.758548 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.758809 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.758925 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.759102 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.759201 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.759411 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.759509 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.759742 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.759858 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.760306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.760414 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.760602 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.761365 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.761527 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.761611 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.761886 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.762011 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.762183 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.762337 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.762503 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.762662 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.762821 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.762998 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.763154 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.763293 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.763475 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.763624 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.763792 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.763975 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.764150 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.764254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.764472 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.764583 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.764807 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.764945 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.765136 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.765286 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.765465 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.765604 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.765788 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.765938 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.766099 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.766272 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.766414 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.766599 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.766727 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.766913 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.767038 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.767231 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.767352 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.767545 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.767667 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.767865 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.767965 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.768179 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.768271 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.768498 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.768601 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.768946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.769091 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.769262 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.769380 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.769577 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.769698 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.769895 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.770022 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.770208 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.770334 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.770536 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.770661 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.770846 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.770967 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.771156 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.771283 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.771467 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.771586 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.771779 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.771899 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.772132 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.772263 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.772446 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.772565 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.772807 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.772940 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.773299 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.773629 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.773965 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.774211 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.774344 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.774556 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.774661 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.774892 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.774994 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.775216 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.775307 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.775538 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.775679 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.775858 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.775960 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.776185 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.776921 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.777112 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.777456 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.777775 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.778111 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.778241 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.778463 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.778560 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.778824 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.778968 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.779165 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.779259 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.779493 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.779587 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.779837 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.779928 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.780164 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.780264 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.780493 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.780583 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.780864 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.780978 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.781172 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.781264 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.781494 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.781604 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.781814 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.781914 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.782133 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.782233 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.782450 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.782554 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.782769 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.782861 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.783094 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.783187 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.783414 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.783563 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.783736 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.783867 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.784053 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.784183 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.784379 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.784518 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.784698 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.784932 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.785041 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.785139 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.785351 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.785467 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.785672 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.785819 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.786005 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.786106 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.786323 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.786416 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.786645 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.786737 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.786961 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.787061 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.787291 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.787392 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.787610 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.787703 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.787935 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.788033 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.788269 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.788363 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.788593 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.788685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.788940 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.789045 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.789265 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.789365 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.789582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.789673 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.789899 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.790004 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.790218 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.790426 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.790545 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.790750 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.790850 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.791126 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.791225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.791444 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.791536 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.791759 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.791861 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.792133 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.792294 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.792447 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.792579 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.792828 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.793043 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.793151 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.793393 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.793537 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.793726 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.793874 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.794081 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.794204 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.794420 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.794514 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.794734 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.794850 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.795052 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.795171 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.795375 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.795487 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.795689 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.795807 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.796005 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.796158 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.796309 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.796411 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.796618 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.796735 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.796996 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.797098 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.797310 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.797408 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.797620 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.797724 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.797985 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.798118 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.798976 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.799119 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.799234 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.799357 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.799469 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.799586 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.799710 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.799830 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.799941 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.800066 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.800179 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.800290 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.800408 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.800528 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.800648 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.800813 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.800940 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.801052 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.801171 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.801284 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.801410 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.801532 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.801690 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.801810 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.803140 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.803272 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.803406 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.803525 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.803660 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.803771 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.803888 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.804017 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.804152 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.804265 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.804376 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.804498 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.804618 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.804777 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.804914 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.805652 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.805750 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.805835 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.805920 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.806021 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.806116 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.806263 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.806354 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.806447 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.806534 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.806632 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.806719 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.806812 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.806898 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.806983 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.807078 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.807173 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.807300 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.807441 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.807644 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.807747 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.807967 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.808285 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.808390 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.808606 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.808708 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.808946 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.809051 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.809262 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.809375 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.809577 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.809677 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.809948 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.810079 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.810267 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.810363 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.810582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.810681 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.810895 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.810987 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.811210 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.811313 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.811533 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.811625 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.811846 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.811947 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.812166 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.812258 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.812476 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.812569 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.812834 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.812960 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.813157 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.813253 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.813472 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.813573 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.813788 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.813894 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.814099 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.814190 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.814448 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.814539 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.814760 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.814897 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.815109 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.815230 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.815447 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.815618 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.815799 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.816023 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.816118 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.816343 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.816438 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.816657 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.816787 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.817027 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.817123 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.817359 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.817472 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.817671 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.817821 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.817994 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.818148 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.818312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.818502 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.818623 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.818858 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.818951 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.819176 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.819259 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.819496 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.819632 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.819814 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.819915 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.820133 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.820262 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.820457 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.820586 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.820791 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.820900 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.821115 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.821208 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.821431 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.821538 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.821743 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.821851 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.822054 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.822155 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.822363 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.822468 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.822675 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.822768 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.822984 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.823083 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.823830 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.824146 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.824241 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.824472 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.824564 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.824807 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.824952 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.825124 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.825270 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.825434 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.825571 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.825751 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.825921 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.826066 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.826158 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.826378 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.826470 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.826711 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.826864 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.827029 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.827150 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.827341 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.827439 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.827652 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.827803 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.827968 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.828163 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.828278 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.828501 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.828621 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.828875 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.828980 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.829234 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.829337 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.829549 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.829653 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.829862 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.829953 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.830177 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.830268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.830488 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.830592 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.830802 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.830902 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.831114 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.831207 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.831430 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.831530 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.831741 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.831840 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.832051 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.832142 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.832359 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.832453 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.832671 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.832807 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.833006 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.833107 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.833330 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.833431 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.833641 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.833742 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.833950 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.834042 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.834258 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.834358 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.834566 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.834657 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.834891 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.835064 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.835208 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.835344 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.835502 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.835605 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.835814 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.835958 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.836163 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.836292 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.836474 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.836570 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.836811 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.836921 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.837130 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.837229 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.837450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.837542 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.837761 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.837867 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.838082 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.838181 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.838396 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.838494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.838716 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.839429 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.839634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.839781 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.839986 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.840320 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.840413 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.840643 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.840762 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.840990 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.841093 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.841313 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.841414 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.842071 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.842192 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.842192 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.842370 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.842457 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.842556 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.842644 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.842728 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.842868 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.842962 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.843183 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.843291 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.843499 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.843592 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.843812 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.843916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.844129 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.844276 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.844450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.844570 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.844803 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.844973 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.845135 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.845297 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.845446 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.845597 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.845752 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.845897 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.846055 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.846207 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.846353 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.846498 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.846665 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.846825 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.846990 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.847133 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.847277 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.847429 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.847581 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.847726 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.847884 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.848036 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.848181 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.848324 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.848500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.848661 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.848850 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.848955 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.849403 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.849723 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.850044 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.850212 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.850357 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.850552 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.850675 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.850880 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.850983 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.851217 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.851342 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.851544 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.851652 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.851905 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.852004 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.852317 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.852425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.852637 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.852768 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.852981 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.853090 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.853303 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.853411 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.853626 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.853735 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.853957 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.854121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.854292 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.854414 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.854653 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.854743 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.855017 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.855135 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.855280 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.855428 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.855592 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.855748 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.855924 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.856069 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.856237 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.856384 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.856566 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.856699 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.857022 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.857124 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.857340 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.857440 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.857653 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.857746 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.857963 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.858080 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.858276 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.858403 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.858607 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.858727 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.858922 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.859058 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.859253 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.859372 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.859672 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.859766 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.859986 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.860089 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.860297 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.860414 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.860612 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.860775 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.860968 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.861070 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.861301 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.861464 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.861619 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.861713 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.861940 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.862039 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.862252 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.862346 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.862582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.862684 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.862912 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.863013 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.863227 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.863334 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.863556 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.863647 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.863886 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.863987 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.864204 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.864308 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.864525 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.864619 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.864863 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.864961 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.865195 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.865307 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.865525 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.865627 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.865847 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.865940 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.866166 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.866265 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.866478 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.866584 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.866794 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.866887 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.867125 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.867219 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.867438 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.867539 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.867757 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.867849 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.868074 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.868175 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.868396 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.868489 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.868708 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.868875 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.869041 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.869137 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.869371 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.869499 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.869683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.869785 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.870517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.870756 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.870917 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.871038 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.871154 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.871275 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.872217 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.872362 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.872362 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.872582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.872582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.872863 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.872981 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.873092 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.873211 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.873331 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.873451 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.873578 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.873693 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.873806 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.873924 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.874042 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.874169 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.874281 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.874401 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.874512 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.874632 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.874745 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.874958 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.875070 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.875232 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.875327 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.875540 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.875639 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.875853 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.875981 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.876203 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.876300 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.876516 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.876610 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.880756 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.880906 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.880994 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.881097 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.881188 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.881284 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.881362 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.881437 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.881517 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.881601 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.881681 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.881764 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.881852 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.881929 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.882000 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.882072 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.882072 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.882217 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.882299 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.882372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.882444 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.882516 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.882594 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.882678 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.882751 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.882823 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.882901 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.882901 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.882901 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.882901 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.882901 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.882901 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.882901 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.883384 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.883384 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.883716 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.883899 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.884049 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.884368 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.884637 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.884773 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.885285 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.885614 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.886320 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.886477 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.886813 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.887114 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.887220 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.887453 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.887777 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.887951 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.888093 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.888421 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.888674 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.888813 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.889091 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.889432 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.889678 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.890476 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.890476 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.890646 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.890900 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.891099 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.891260 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.891585 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.891703 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.891910 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.892023 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.892227 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.892334 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.892546 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.892663 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.892888 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.893000 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.893241 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.893347 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.893624 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.893721 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.893904 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.894010 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.894231 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.894332 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.894557 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.894666 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.894885 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.894999 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.895213 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.895313 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.895537 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.895649 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.895890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.895989 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.896215 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.896313 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.896535 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.896634 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.896951 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.897050 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.897241 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.897342 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.897532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.897634 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.897844 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.897944 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.898163 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.898272 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.898494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.898603 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.898816 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.898927 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.899137 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.899237 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.899480 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.899708 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.899810 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.900049 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.900173 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.900703 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.900834 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.900944 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.901023 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.901096 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.901171 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.902099 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.902279 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.902459 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.902617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.902771 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.902926 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.903090 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.903090 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.903401 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.903554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.903716 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.903870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.904032 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.904197 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.904352 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.904523 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.904678 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.904874 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.905031 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.905199 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.905361 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.905361 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.905659 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.905813 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.905975 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.906140 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.906295 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.906459 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.906619 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.906777 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.906943 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.907105 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.907267 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.907422 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.907574 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.907741 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.907895 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.908055 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.908208 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.908388 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.908542 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.908706 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.908886 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.908886 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.909192 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.909347 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.909507 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.909671 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.909826 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.909979 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.910132 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.910292 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.910458 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.910978 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.911142 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.911305 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.911461 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.911623 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.911787 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.912255 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.912421 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.912586 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.912827 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.913038 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.913216 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.913371 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.913527 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.913527 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.913818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.913973 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.914137 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.914291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.914460 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.914616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.914769 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.914923 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.915148 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.915317 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.915470 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.915624 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.915777 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.915945 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.916109 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.916265 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.916426 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.916588 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.916767 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.916965 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.917127 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.917282 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.917446 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.917615 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.917770 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.917938 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.918100 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.918253 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.918406 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.918566 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.918566 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.918868 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.919023 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.919183 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.919338 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.919509 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.919673 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.919673 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.919982 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.920145 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.920411 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.920576 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.921135 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.921310 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.921467 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.921629 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.921783 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.921957 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.922361 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.922623 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.922792 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.922949 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.923102 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.923255 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.923491 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.923648 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.923801 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.923956 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.924109 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.924276 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.924442 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.924603 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.924787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.924948 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.925102 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.925102 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.925407 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.925569 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.925723 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.925876 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.926035 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.926206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.926362 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.926527 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.926688 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.926842 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.927013 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.927169 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.927323 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.927475 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.927636 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.927798 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.927965 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.928120 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.928274 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.928445 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.928606 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.928795 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.928968 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.929130 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.929285 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.929437 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.929591 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.929751 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.929915 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.930069 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.930222 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.930376 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.930539 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.930706 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.931236 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.931439 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.931613 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.931777 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.931939 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.932104 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.933242 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.933433 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.933592 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.933755 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.933910 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.933910 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.934227 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.934389 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.934544 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.934706 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.934861 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.935029 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.935191 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.935346 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.935499 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.935663 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.935830 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.936011 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.936177 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.936341 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.936505 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.936679 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.936904 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.937062 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.937062 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.937372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.937527 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.937696 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.937860 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.938028 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.938028 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.938343 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.938505 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.938674 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.938829 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.938981 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.939134 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.939294 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.939488 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.939663 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.939820 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.939981 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.940153 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.940309 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.940512 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.940686 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.940876 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.941395 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.941570 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.941733 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.941899 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.942054 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.942206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.942523 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.942773 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.942954 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.943124 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.943299 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.943544 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.943710 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.943875 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.944039 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.944207 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.944370 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.944524 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.944677 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.944856 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.945024 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.945192 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.945348 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.945501 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.945654 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.945815 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.945985 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.946144 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.946298 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.946451 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.946604 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.946764 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.946927 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.947104 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.947267 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.947421 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.947581 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.947741 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.947905 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.948066 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.948281 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.948996 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.949164 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.949388 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.949566 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.949741 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.949905 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.950059 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.950214 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.950214 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.950530 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.950693 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.950847 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.950999 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.951170 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.951679 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.951843 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.951997 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.952163 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.952318 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.952614 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.952814 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.953062 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.953221 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.953377 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.953549 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.953804 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.953971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.954126 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.954288 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.954462 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.954462 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.954780 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.954934 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.955095 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.955248 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.955410 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.955565 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.955732 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.955886 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.956058 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.956221 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.956375 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.956621 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.956798 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.956958 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.957112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.957276 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.957439 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.957608 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.957771 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.957925 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.958077 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.958238 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.958392 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.958554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.958721 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.958882 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.959036 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.959189 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.959357 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.959520 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.959675 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.959827 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.959981 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.960133 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.960296 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.960457 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.960629 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.960819 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.960819 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.961115 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.961286 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.961813 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.961982 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.962136 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.962292 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.962445 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.962754 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.962915 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.963088 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.963358 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.963525 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.963693 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.964017 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.964248 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.964456 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.964614 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.964799 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.964975 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.965138 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.965300 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.965454 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.965631 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.965786 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.965957 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.966123 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.966286 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.966447 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.966601 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.966761 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.966925 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.967080 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.967242 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.967404 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.967558 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.967736 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.967891 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.968046 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.968200 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.968354 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.968507 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.968670 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.968889 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.969055 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.969210 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.969364 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.969526 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 12:31:38.969706 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.969706 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.969706 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.969706 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.969706 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.969706 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.969706 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.969706 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.970877 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.970877 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.970877 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.970877 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.970877 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.970877 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.970877 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.970877 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.972504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.972504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.972504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.972504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.972504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.972504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.972504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.972504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.974033 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.974033 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.974033 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.974033 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.974033 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.974033 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.974033 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:31:38.974033 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 12:31:39.022578 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO dbcounter [None req-d39e954d-54ae-4ba4-8e63-6f513d203879 None None] Registered counter for database nova_api May 26 12:31:39.033435 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO dbcounter [None req-e27dba4d-ac3b-491b-a16e-fa4a97f00b7e None None] Registered counter for database nova_api May 26 12:31:39.044938 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_db.sqlalchemy.engines [None req-d39e954d-54ae-4ba4-8e63-6f513d203879 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:31:39.052846 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writer thread running {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:31:39.053311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_db.sqlalchemy.engines [None req-e27dba4d-ac3b-491b-a16e-fa4a97f00b7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:31:39.061495 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writer thread running {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:31:39.113384 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.context [None req-d39e954d-54ae-4ba4-8e63-6f513d203879 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),647fb890-3516-4fd3-bb90-bcfdb9dc4d4a(cell1) {{(pid=124133) load_cells /opt/stack/nova/nova/context.py:464}} May 26 12:31:39.117608 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d39e954d-54ae-4ba4-8e63-6f513d203879 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:31:39.119218 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d39e954d-54ae-4ba4-8e63-6f513d203879 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:31:39.120093 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d39e954d-54ae-4ba4-8e63-6f513d203879 None None] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:31:39.120354 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.context [None req-e27dba4d-ac3b-491b-a16e-fa4a97f00b7e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),647fb890-3516-4fd3-bb90-bcfdb9dc4d4a(cell1) {{(pid=124134) load_cells /opt/stack/nova/nova/context.py:464}} May 26 12:31:39.122282 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d39e954d-54ae-4ba4-8e63-6f513d203879 None None] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:31:39.124300 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO dbcounter [None req-d39e954d-54ae-4ba4-8e63-6f513d203879 None None] Registered counter for database nova_cell0 May 26 12:31:39.125924 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e27dba4d-ac3b-491b-a16e-fa4a97f00b7e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:31:39.127628 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e27dba4d-ac3b-491b-a16e-fa4a97f00b7e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:31:39.128372 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO dbcounter [None req-d39e954d-54ae-4ba4-8e63-6f513d203879 None None] Registered counter for database nova_cell1 May 26 12:31:39.128482 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e27dba4d-ac3b-491b-a16e-fa4a97f00b7e None None] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:31:39.130544 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e27dba4d-ac3b-491b-a16e-fa4a97f00b7e None None] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:31:39.132551 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO dbcounter [None req-e27dba4d-ac3b-491b-a16e-fa4a97f00b7e None None] Registered counter for database nova_cell0 May 26 12:31:39.137330 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO dbcounter [None req-e27dba4d-ac3b-491b-a16e-fa4a97f00b7e None None] Registered counter for database nova_cell1 May 26 12:31:39.137720 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_db.sqlalchemy.engines [None req-d39e954d-54ae-4ba4-8e63-6f513d203879 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:31:39.138540 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_db.sqlalchemy.engines [None req-d39e954d-54ae-4ba4-8e63-6f513d203879 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:31:39.145647 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_db.sqlalchemy.engines [None req-e27dba4d-ac3b-491b-a16e-fa4a97f00b7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:31:39.146579 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writer thread running {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:31:39.146764 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_db.sqlalchemy.engines [None req-e27dba4d-ac3b-491b-a16e-fa4a97f00b7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:31:39.146926 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writer thread running {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:31:39.154036 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writer thread running {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:31:39.155404 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writer thread running {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:31:39.294932 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO dbcounter [None req-d39e954d-54ae-4ba4-8e63-6f513d203879 None None] Registered counter for database nova_cell0 May 26 12:31:39.301922 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_db.sqlalchemy.engines [None req-d39e954d-54ae-4ba4-8e63-6f513d203879 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:31:39.303338 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO dbcounter [None req-e27dba4d-ac3b-491b-a16e-fa4a97f00b7e None None] Registered counter for database nova_cell0 May 26 12:31:39.306494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writer thread running {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:31:39.310794 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_db.sqlalchemy.engines [None req-e27dba4d-ac3b-491b-a16e-fa4a97f00b7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:31:39.315315 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writer thread running {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:31:39.634354 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: WARNING keystonemiddleware.auth_token [None req-d39e954d-54ae-4ba4-8e63-6f513d203879 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:31:39.638768 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: WARNING keystonemiddleware.auth_token [None req-e27dba4d-ac3b-491b-a16e-fa4a97f00b7e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:31:39.642391 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: WARNING keystonemiddleware.auth_token [None req-d39e954d-54ae-4ba4-8e63-6f513d203879 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:31:39.646556 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: WARNING keystonemiddleware.auth_token [None req-e27dba4d-ac3b-491b-a16e-fa4a97f00b7e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:31:40.006069 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: WARNING keystonemiddleware.auth_token [None req-e27dba4d-ac3b-491b-a16e-fa4a97f00b7e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:31:40.012332 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: WARNING keystonemiddleware.auth_token [None req-d39e954d-54ae-4ba4-8e63-6f513d203879 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:31:40.014011 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: WARNING keystonemiddleware.auth_token [None req-e27dba4d-ac3b-491b-a16e-fa4a97f00b7e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:31:40.019680 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562c88c6f9c0 pid: 124134 (default app) May 26 12:31:40.020560 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: WARNING keystonemiddleware.auth_token [None req-d39e954d-54ae-4ba4-8e63-6f513d203879 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:31:40.027061 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562c88c6f9c0 pid: 124133 (default app) May 26 12:32:21.912557 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=3 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:21.915697 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=3 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:21.918327 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell0:SELECT=3 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:21.921347 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell0:SELECT=3 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:24.146639 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-0f82c590-f535-446e-a893-4fd79da087d5 tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] Action: 'create', calling method: .version_select at 0x7fed33440c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1285745566", "metadata": {"Type": "work"}}} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:32:24.172336 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-0f82c590-f535-446e-a893-4fd79da087d5 tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] Request method failure captured: May 26 12:32:24.172336 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 12:32:24.172336 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept: application/json May 26 12:32:24.172336 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept-Encoding: identity May 26 12:32:24.172336 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Connection: close May 26 12:32:24.172336 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Length: 122 May 26 12:32:24.172336 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Type: application/json May 26 12:32:24.172336 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Host: 10.222.0.39 May 26 12:32:24.172336 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Openstack-System-Scope: None May 26 12:32:24.172336 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: User-Agent: python-urllib3/1.26.9 May 26 12:32:24.172336 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Auth-Token: gAAAAABij3NVgmzz99x0G7Jp4DDUzkKpkfrM_TknoumUR6rKoB2xeo01P1eA1IWVt2hX3JgUeT0aczwOT6F7vOaaHm_5djxC1qwcl1rHH5PYGmn13Fz4DjgTRhtRQl5M_3Z6WZ14He8SLi540SMKas3Lg6xipEUTzZ_mQpwcrvpWyhEHWrxMVGA May 26 12:32:24.172336 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Id: None May 26 12:32:24.172336 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Name: None May 26 12:32:24.172336 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Identity-Status: Confirmed May 26 12:32:24.172336 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Is-Admin-Project: True May 26 12:32:24.172336 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Id: default May 26 12:32:24.172336 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Name: Default May 26 12:32:24.172336 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Id: 91bc9228161843beb63d71faddf3dfa5 May 26 12:32:24.172336 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Name: tempest-VolumesNegativeTest-588098238 May 26 12:32:24.172336 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Role: member,reader May 26 12:32:24.172336 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Roles: member,reader May 26 12:32:24.174255 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91bc9228161843beb63d71faddf3dfa5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_91bc9228161843beb63d71faddf3dfa5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91bc9228161843beb63d71faddf3dfa5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/91bc9228161843beb63d71faddf3dfa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:32:24.174255 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant: tempest-VolumesNegativeTest-588098238 May 26 12:32:24.174255 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Id: 91bc9228161843beb63d71faddf3dfa5 May 26 12:32:24.174255 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Name: tempest-VolumesNegativeTest-588098238 May 26 12:32:24.174255 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User: tempest-VolumesNegativeTest-588098238-project May 26 12:32:24.174255 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Id: default May 26 12:32:24.174255 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Name: Default May 26 12:32:24.174255 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Id: c31af84396fa48aa9da4fa2591141cd3 May 26 12:32:24.174255 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Name: tempest-VolumesNegativeTest-588098238-project May 26 12:32:24.174255 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: May 26 12:32:24.174255 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1285745566", "metadata": {"Type": "work"}}} May 26 12:32:24.174255 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: method: May 26 12:32:24.174255 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 12:32:24.175285 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1285745566', 'metadata': {'Type': 'work'}}}} May 26 12:32:24.175285 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:32:24.175285 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:32:24.175285 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 12:32:24.175285 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 12:32:24.175285 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 12:32:24.175285 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise error May 26 12:32:24.175285 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 26 12:32:24.175285 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:32:24.175285 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 12:32:24.175285 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 12:32:24.175285 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:32:24.175285 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 12:32:24.175285 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi '#$%' May 26 12:32:24.175285 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:32:24.175285 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:32:24.175285 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:32:24.175285 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:32:24.175285 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:32:24.175285 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:32:24.175285 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:32:24.175285 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:32:24.178072 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:32:24.178072 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:32:24.178072 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:32:24.178072 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:32:24.178072 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 12:32:24.178072 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 12:32:24.178072 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 12:32:24.178072 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 12:32:24.178072 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 12:32:24.178072 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 12:32:24.178072 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 12:32:24.178072 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:32:24.178072 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:32:24.178072 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:32:24.178072 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:32:24.178072 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:32:24.178072 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:32:24.178072 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 12:32:24.178072 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 12:32:24.179602 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 12:32:24.179602 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:32:24.194787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-0f82c590-f535-446e-a893-4fd79da087d5 tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:32:24.199110 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-0f82c590-f535-446e-a893-4fd79da087d5 tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 2.293127 May 26 12:32:24.202662 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 1/1] 10.222.0.39 () {60 vars in 1155 bytes} [Thu May 26 12:32:21 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 2299 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 12:32:24.722204 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-48170bfb-077a-4032-8359-b10eacda648d tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] Action: 'create', calling method: .version_select at 0x7fed33dc9280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-295241286", "metadata": {"Type": "work"}}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:32:24.742081 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-48170bfb-077a-4032-8359-b10eacda648d tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] Request method failure captured: May 26 12:32:24.742081 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 12:32:24.742081 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:32:24.742081 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:32:24.742081 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:32:24.742081 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 119 May 26 12:32:24.742081 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:32:24.742081 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:32:24.742081 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:32:24.742081 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:32:24.742081 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3NVgmzz99x0G7Jp4DDUzkKpkfrM_TknoumUR6rKoB2xeo01P1eA1IWVt2hX3JgUeT0aczwOT6F7vOaaHm_5djxC1qwcl1rHH5PYGmn13Fz4DjgTRhtRQl5M_3Z6WZ14He8SLi540SMKas3Lg6xipEUTzZ_mQpwcrvpWyhEHWrxMVGA May 26 12:32:24.742081 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:32:24.742081 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:32:24.742081 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:32:24.742081 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:32:24.742081 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:32:24.742081 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:32:24.742081 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: 91bc9228161843beb63d71faddf3dfa5 May 26 12:32:24.742081 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-VolumesNegativeTest-588098238 May 26 12:32:24.742081 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:32:24.742081 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:32:24.743715 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91bc9228161843beb63d71faddf3dfa5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_91bc9228161843beb63d71faddf3dfa5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91bc9228161843beb63d71faddf3dfa5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/91bc9228161843beb63d71faddf3dfa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:32:24.743715 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-VolumesNegativeTest-588098238 May 26 12:32:24.743715 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: 91bc9228161843beb63d71faddf3dfa5 May 26 12:32:24.743715 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-VolumesNegativeTest-588098238 May 26 12:32:24.743715 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-VolumesNegativeTest-588098238-project May 26 12:32:24.743715 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:32:24.743715 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:32:24.743715 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: c31af84396fa48aa9da4fa2591141cd3 May 26 12:32:24.743715 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-VolumesNegativeTest-588098238-project May 26 12:32:24.743715 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: May 26 12:32:24.743715 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-295241286", "metadata": {"Type": "work"}}} May 26 12:32:24.743715 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: May 26 12:32:24.743715 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 12:32:24.744616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-295241286', 'metadata': {'Type': 'work'}}}} May 26 12:32:24.744616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:32:24.744616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:32:24.744616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 12:32:24.744616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 12:32:24.744616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 12:32:24.744616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise error May 26 12:32:24.744616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 26 12:32:24.744616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:24.744616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 26 12:32:24.744616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 12:32:24.744616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:24.744616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 12:32:24.744616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi '0' May 26 12:32:24.744616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:24.744616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:32:24.744616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:24.744616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:32:24.744616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:32:24.744616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:32:24.744616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:32:24.744616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:32:24.746667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:32:24.746667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:32:24.746667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:32:24.746667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:32:24.746667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 12:32:24.746667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 12:32:24.746667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 12:32:24.746667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 12:32:24.746667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 12:32:24.746667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 12:32:24.746667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 12:32:24.746667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:24.746667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:32:24.746667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:24.746667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:32:24.746667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:32:24.746667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:32:24.746667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 12:32:24.746667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 12:32:24.747899 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 12:32:24.747899 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:24.749089 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-48170bfb-077a-4032-8359-b10eacda648d tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:32:24.750532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-48170bfb-077a-4032-8359-b10eacda648d tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.542692 May 26 12:32:24.751714 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 1/2] 10.222.0.39 () {60 vars in 1155 bytes} [Thu May 26 12:32:24 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 545 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 12:32:24.764336 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-5d10167a-268d-4f8e-80ce-4f59e5d4fa90 tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] Action: 'create', calling method: .version_select at 0x7fed33326ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2037159359", "metadata": {"Type": "work"}}} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:32:24.767644 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-5d10167a-268d-4f8e-80ce-4f59e5d4fa90 tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] Request method failure captured: May 26 12:32:24.767644 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 12:32:24.767644 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept: application/json May 26 12:32:24.767644 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept-Encoding: identity May 26 12:32:24.767644 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Connection: close May 26 12:32:24.767644 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Length: 119 May 26 12:32:24.767644 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Type: application/json May 26 12:32:24.767644 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Host: 10.222.0.39 May 26 12:32:24.767644 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Openstack-System-Scope: None May 26 12:32:24.767644 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: User-Agent: python-urllib3/1.26.9 May 26 12:32:24.767644 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Auth-Token: gAAAAABij3NVgmzz99x0G7Jp4DDUzkKpkfrM_TknoumUR6rKoB2xeo01P1eA1IWVt2hX3JgUeT0aczwOT6F7vOaaHm_5djxC1qwcl1rHH5PYGmn13Fz4DjgTRhtRQl5M_3Z6WZ14He8SLi540SMKas3Lg6xipEUTzZ_mQpwcrvpWyhEHWrxMVGA May 26 12:32:24.767644 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Id: None May 26 12:32:24.767644 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Name: None May 26 12:32:24.767644 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Identity-Status: Confirmed May 26 12:32:24.767644 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Is-Admin-Project: True May 26 12:32:24.767644 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Id: default May 26 12:32:24.767644 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Name: Default May 26 12:32:24.767644 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Id: 91bc9228161843beb63d71faddf3dfa5 May 26 12:32:24.767644 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Name: tempest-VolumesNegativeTest-588098238 May 26 12:32:24.767644 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Role: member,reader May 26 12:32:24.767644 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Roles: member,reader May 26 12:32:24.768931 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91bc9228161843beb63d71faddf3dfa5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_91bc9228161843beb63d71faddf3dfa5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91bc9228161843beb63d71faddf3dfa5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/91bc9228161843beb63d71faddf3dfa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:32:24.768931 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant: tempest-VolumesNegativeTest-588098238 May 26 12:32:24.768931 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Id: 91bc9228161843beb63d71faddf3dfa5 May 26 12:32:24.768931 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Name: tempest-VolumesNegativeTest-588098238 May 26 12:32:24.768931 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User: tempest-VolumesNegativeTest-588098238-project May 26 12:32:24.768931 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Id: default May 26 12:32:24.768931 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Name: Default May 26 12:32:24.768931 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Id: c31af84396fa48aa9da4fa2591141cd3 May 26 12:32:24.768931 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Name: tempest-VolumesNegativeTest-588098238-project May 26 12:32:24.768931 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: May 26 12:32:24.768931 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2037159359", "metadata": {"Type": "work"}}} May 26 12:32:24.768931 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: method: May 26 12:32:24.768931 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 12:32:24.769816 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2037159359', 'metadata': {'Type': 'work'}}}} May 26 12:32:24.769816 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:32:24.769816 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:32:24.769816 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 12:32:24.769816 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 12:32:24.769816 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 12:32:24.769816 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise error May 26 12:32:24.769816 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 26 12:32:24.769816 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:32:24.769816 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 12:32:24.769816 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 12:32:24.769816 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:32:24.769816 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 12:32:24.769816 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi '' May 26 12:32:24.769816 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:32:24.769816 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:32:24.769816 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:32:24.769816 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:32:24.769816 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:32:24.769816 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:32:24.769816 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:32:24.769816 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:32:24.771510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:32:24.771510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:32:24.771510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:32:24.771510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:32:24.771510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 12:32:24.771510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 12:32:24.771510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 12:32:24.771510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 12:32:24.771510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 12:32:24.771510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 12:32:24.771510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 12:32:24.771510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:32:24.771510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:32:24.771510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:32:24.771510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:32:24.771510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:32:24.771510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:32:24.771510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 12:32:24.771510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 12:32:24.772627 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 12:32:24.772627 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:32:24.772627 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-5d10167a-268d-4f8e-80ce-4f59e5d4fa90 tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:32:24.772627 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-5d10167a-268d-4f8e-80ce-4f59e5d4fa90 tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015785 May 26 12:32:24.775774 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 2/3] 10.222.0.39 () {60 vars in 1155 bytes} [Thu May 26 12:32:24 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 12:32:24.780321 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=3 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:24.781383 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=3 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:24.782815 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=3 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:24.794660 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=3 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:24.813149 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-52cd2ac4-ca56-4c6a-bd6a-b5258b78ed1f tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] Calling method '.version_select at 0x7fed334821f0>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:25.529687 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b9a8e74c-b7a9-4973-9549-e5ce1c64625c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-415811860", "imageRef": "7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4", "flavorRef": "452", "networks": [{"uuid": "4d0d4a1a-1ef3-4ac8-82a5-2f304e956c75"}]}} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:32:26.106345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-52cd2ac4-ca56-4c6a-bd6a-b5258b78ed1f tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] HTTP exception thrown: Volume tempest-invalid-703967381 could not be found. May 26 12:32:26.110309 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-52cd2ac4-ca56-4c6a-bd6a-b5258b78ed1f tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] Request method failure captured: May 26 12:32:26.110309 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-703967381 HTTP/1.1 May 26 12:32:26.110309 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:32:26.110309 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:32:26.110309 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:32:26.110309 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:32:26.110309 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:32:26.110309 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:32:26.110309 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:32:26.110309 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:32:26.110309 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3NVgmzz99x0G7Jp4DDUzkKpkfrM_TknoumUR6rKoB2xeo01P1eA1IWVt2hX3JgUeT0aczwOT6F7vOaaHm_5djxC1qwcl1rHH5PYGmn13Fz4DjgTRhtRQl5M_3Z6WZ14He8SLi540SMKas3Lg6xipEUTzZ_mQpwcrvpWyhEHWrxMVGA May 26 12:32:26.110309 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:32:26.110309 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:32:26.110309 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:32:26.110309 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:32:26.110309 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:32:26.110309 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:32:26.110309 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: 91bc9228161843beb63d71faddf3dfa5 May 26 12:32:26.110309 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-VolumesNegativeTest-588098238 May 26 12:32:26.110309 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:32:26.110309 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:32:26.111593 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91bc9228161843beb63d71faddf3dfa5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_91bc9228161843beb63d71faddf3dfa5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91bc9228161843beb63d71faddf3dfa5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/91bc9228161843beb63d71faddf3dfa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:32:26.111593 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-VolumesNegativeTest-588098238 May 26 12:32:26.111593 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: 91bc9228161843beb63d71faddf3dfa5 May 26 12:32:26.111593 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-VolumesNegativeTest-588098238 May 26 12:32:26.111593 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-VolumesNegativeTest-588098238-project May 26 12:32:26.111593 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:32:26.111593 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:32:26.111593 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: c31af84396fa48aa9da4fa2591141cd3 May 26 12:32:26.111593 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-VolumesNegativeTest-588098238-project May 26 12:32:26.111593 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: May 26 12:32:26.111593 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Volume tempest-invalid-703967381 could not be found. May 26 12:32:26.111593 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': 'tempest-invalid-703967381'} May 26 12:32:26.111593 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:32:26.112386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:32:26.112386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:32:26.112386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:32:26.112386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 12:32:26.112386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 12:32:26.112386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 12:32:26.112386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 12:32:26.112386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 12:32:26.112386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 12:32:26.112386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 12:32:26.112386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 12:32:26.112386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:32:26.112386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:32:26.112386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:32:26.112386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:32:26.112386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-703967381 could not be found. (HTTP 404) (Request-ID: req-feec0a8a-5f6d-43c0-821d-b1b3e43f2f01) May 26 12:32:26.112386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:26.112386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:32:26.112386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:26.115638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:32:26.115638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 12:32:26.115638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 12:32:26.115638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:32:26.115638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:32:26.115638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:32:26.115638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:32:26.115638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:32:26.115638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:32:26.115638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:32:26.115638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:32:26.115638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 12:32:26.115638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 12:32:26.115638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 12:32:26.115638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 12:32:26.115638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 12:32:26.115638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 12:32:26.115638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 12:32:26.115638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 12:32:26.119121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:32:26.119121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:32:26.119121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:32:26.119121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:32:26.119121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-703967381 could not be found. May 26 12:32:26.119121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:26.119121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:32:26.119121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:26.119121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:32:26.119121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:32:26.119121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:32:26.119121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:32:26.119121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:32:26.119121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:32:26.119121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:32:26.119121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:32:26.119121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:32:26.119121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 12:32:26.119121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:32:26.119121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-703967381 could not be found. May 26 12:32:26.120382 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:26.120382 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:32:26.120382 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:26.120382 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:32:26.120382 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:32:26.120382 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:32:26.120382 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:32:26.120382 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:32:26.120382 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-703967381 could not be found. May 26 12:32:26.120382 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:26.120382 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-52cd2ac4-ca56-4c6a-bd6a-b5258b78ed1f tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] Returning 404 to user: Volume tempest-invalid-703967381 could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:32:26.120382 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-52cd2ac4-ca56-4c6a-bd6a-b5258b78ed1f tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/tempest-invalid-703967381" status: 404 len: 98 microversion: 2.1 time: 1.332923 May 26 12:32:26.120382 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1214 bytes} [Thu May 26 12:32:24 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-703967381 => generated 98 bytes in 1340 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 26 12:32:26.124367 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-a5b14768-fd55-4042-aabf-676dd8759fe9 tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004960 May 26 12:32:26.131448 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 3/5] 10.222.0.39 () {58 vars in 1139 bytes} [Thu May 26 12:32:26 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 12:32:26.138228 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-cd96d89f-ffd0-41a2-a7c9-bd3a605f1044 tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005491 May 26 12:32:26.142655 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 4/6] 10.222.0.39 () {58 vars in 1136 bytes} [Thu May 26 12:32:26 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 12:32:26.147385 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-2b37a370-ed84-4a8c-bf2b-f08b8498e826 tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] Calling method '.version_select at 0x7fed332183a0>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:26.227446 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.network.neutron [None req-b9a8e74c-b7a9-4973-9549-e5ce1c64625c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] validate_networks() for [('4d0d4a1a-1ef3-4ac8-82a5-2f304e956c75', None, None, None, None, None)] {{(pid=124134) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:32:26.280266 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-2b37a370-ed84-4a8c-bf2b-f08b8498e826 tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] HTTP exception thrown: Volume 7637fe74-7d10-4ccd-ac43-3232aea411b3 could not be found. May 26 12:32:26.282345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-2b37a370-ed84-4a8c-bf2b-f08b8498e826 tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] Request method failure captured: May 26 12:32:26.282345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: DELETE /compute/v2.1/os-volumes/7637fe74-7d10-4ccd-ac43-3232aea411b3 HTTP/1.1 May 26 12:32:26.282345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:32:26.282345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:32:26.282345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:32:26.282345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:32:26.282345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:32:26.282345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:32:26.282345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:32:26.282345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:32:26.282345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3NVgmzz99x0G7Jp4DDUzkKpkfrM_TknoumUR6rKoB2xeo01P1eA1IWVt2hX3JgUeT0aczwOT6F7vOaaHm_5djxC1qwcl1rHH5PYGmn13Fz4DjgTRhtRQl5M_3Z6WZ14He8SLi540SMKas3Lg6xipEUTzZ_mQpwcrvpWyhEHWrxMVGA May 26 12:32:26.282345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:32:26.282345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:32:26.282345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:32:26.282345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:32:26.282345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:32:26.282345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:32:26.282345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: 91bc9228161843beb63d71faddf3dfa5 May 26 12:32:26.282345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-VolumesNegativeTest-588098238 May 26 12:32:26.282345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:32:26.282345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:32:26.283354 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91bc9228161843beb63d71faddf3dfa5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_91bc9228161843beb63d71faddf3dfa5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91bc9228161843beb63d71faddf3dfa5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/91bc9228161843beb63d71faddf3dfa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:32:26.283354 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-VolumesNegativeTest-588098238 May 26 12:32:26.283354 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: 91bc9228161843beb63d71faddf3dfa5 May 26 12:32:26.283354 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-VolumesNegativeTest-588098238 May 26 12:32:26.283354 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-VolumesNegativeTest-588098238-project May 26 12:32:26.283354 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:32:26.283354 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:32:26.283354 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: c31af84396fa48aa9da4fa2591141cd3 May 26 12:32:26.283354 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-VolumesNegativeTest-588098238-project May 26 12:32:26.283354 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: May 26 12:32:26.283354 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Volume 7637fe74-7d10-4ccd-ac43-3232aea411b3 could not be found. May 26 12:32:26.283354 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': '7637fe74-7d10-4ccd-ac43-3232aea411b3'} May 26 12:32:26.283354 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:32:26.283915 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:32:26.283915 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:32:26.283915 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:32:26.283915 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 12:32:26.283915 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 12:32:26.283915 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 12:32:26.283915 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 12:32:26.283915 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 12:32:26.283915 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 12:32:26.283915 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 12:32:26.283915 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 12:32:26.283915 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:32:26.283915 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:32:26.283915 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:32:26.283915 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:32:26.283915 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7637fe74-7d10-4ccd-ac43-3232aea411b3 could not be found. (HTTP 404) (Request-ID: req-e95774ec-5174-416b-a94a-b27073be7115) May 26 12:32:26.283915 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:26.283915 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:32:26.283915 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:26.286092 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:32:26.286092 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 12:32:26.286092 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 12:32:26.286092 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:32:26.286092 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:32:26.286092 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:32:26.286092 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:32:26.286092 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:32:26.286092 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:32:26.286092 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:32:26.286092 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:32:26.286092 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 12:32:26.286092 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 12:32:26.286092 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 12:32:26.286092 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 12:32:26.286092 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 12:32:26.286092 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 12:32:26.286092 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 12:32:26.286092 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 12:32:26.286907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:32:26.286907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:32:26.286907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:32:26.286907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:32:26.286907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7637fe74-7d10-4ccd-ac43-3232aea411b3 could not be found. May 26 12:32:26.286907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:26.286907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:32:26.286907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:26.286907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:32:26.286907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:32:26.286907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:32:26.286907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:32:26.286907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:32:26.286907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:32:26.286907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:32:26.286907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:32:26.286907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:32:26.286907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 12:32:26.286907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:32:26.287829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7637fe74-7d10-4ccd-ac43-3232aea411b3 could not be found. May 26 12:32:26.287829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:26.287829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:32:26.287829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:26.287829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:32:26.287829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:32:26.287829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:32:26.287829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:32:26.287829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:32:26.287829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7637fe74-7d10-4ccd-ac43-3232aea411b3 could not be found. May 26 12:32:26.287829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:26.287829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-2b37a370-ed84-4a8c-bf2b-f08b8498e826 tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] Returning 404 to user: Volume 7637fe74-7d10-4ccd-ac43-3232aea411b3 could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:32:26.287829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-2b37a370-ed84-4a8c-bf2b-f08b8498e826 tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/7637fe74-7d10-4ccd-ac43-3232aea411b3" status: 404 len: 109 microversion: 2.1 time: 0.139938 May 26 12:32:26.287829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 5/7] 10.222.0.39 () {58 vars in 1247 bytes} [Thu May 26 12:32:26 2022] DELETE /compute/v2.1/os-volumes/7637fe74-7d10-4ccd-ac43-3232aea411b3 => generated 109 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:32:26.293921 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-29ff81db-448a-45a0-b82b-bb48b7e1bc5a tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] Calling method '.version_select at 0x7fed3321d040>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:26.363296 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-29ff81db-448a-45a0-b82b-bb48b7e1bc5a tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] HTTP exception thrown: Volume a2ff4862-b9e3-4bfe-a0c5-5e166e70a396 could not be found. May 26 12:32:26.365268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-29ff81db-448a-45a0-b82b-bb48b7e1bc5a tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] Request method failure captured: May 26 12:32:26.365268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: GET /compute/v2.1/os-volumes/a2ff4862-b9e3-4bfe-a0c5-5e166e70a396 HTTP/1.1 May 26 12:32:26.365268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:32:26.365268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:32:26.365268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:32:26.365268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:32:26.365268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:32:26.365268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:32:26.365268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:32:26.365268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:32:26.365268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3NVgmzz99x0G7Jp4DDUzkKpkfrM_TknoumUR6rKoB2xeo01P1eA1IWVt2hX3JgUeT0aczwOT6F7vOaaHm_5djxC1qwcl1rHH5PYGmn13Fz4DjgTRhtRQl5M_3Z6WZ14He8SLi540SMKas3Lg6xipEUTzZ_mQpwcrvpWyhEHWrxMVGA May 26 12:32:26.365268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:32:26.365268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:32:26.365268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:32:26.365268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:32:26.365268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:32:26.365268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:32:26.365268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: 91bc9228161843beb63d71faddf3dfa5 May 26 12:32:26.365268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-VolumesNegativeTest-588098238 May 26 12:32:26.365268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:32:26.365268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:32:26.366262 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91bc9228161843beb63d71faddf3dfa5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_91bc9228161843beb63d71faddf3dfa5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91bc9228161843beb63d71faddf3dfa5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/91bc9228161843beb63d71faddf3dfa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:32:26.366262 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-VolumesNegativeTest-588098238 May 26 12:32:26.366262 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: 91bc9228161843beb63d71faddf3dfa5 May 26 12:32:26.366262 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-VolumesNegativeTest-588098238 May 26 12:32:26.366262 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-VolumesNegativeTest-588098238-project May 26 12:32:26.366262 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:32:26.366262 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:32:26.366262 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: c31af84396fa48aa9da4fa2591141cd3 May 26 12:32:26.366262 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-VolumesNegativeTest-588098238-project May 26 12:32:26.366262 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: May 26 12:32:26.366262 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Volume a2ff4862-b9e3-4bfe-a0c5-5e166e70a396 could not be found. May 26 12:32:26.366262 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': 'a2ff4862-b9e3-4bfe-a0c5-5e166e70a396'} May 26 12:32:26.366262 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:32:26.366838 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:32:26.366838 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:32:26.366838 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:32:26.366838 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:32:26.366838 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:32:26.366838 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:32:26.366838 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:32:26.366838 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:32:26.366838 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:32:26.366838 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:32:26.366838 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:32:26.366838 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:32:26.366838 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:32:26.366838 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:32:26.366838 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:32:26.366838 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a2ff4862-b9e3-4bfe-a0c5-5e166e70a396 could not be found. (HTTP 404) (Request-ID: req-a44c2540-adb4-43cd-9a02-d49d2c2c174a) May 26 12:32:26.366838 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:26.366838 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:32:26.366838 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:26.367673 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:32:26.367673 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 12:32:26.367673 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 12:32:26.367673 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:32:26.367673 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:32:26.367673 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:32:26.367673 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:32:26.367673 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:32:26.367673 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:32:26.367673 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:32:26.367673 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:32:26.367673 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:32:26.367673 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:32:26.367673 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:32:26.367673 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:32:26.367673 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:32:26.367673 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:32:26.367673 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:32:26.367673 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:32:26.373160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:32:26.373160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:32:26.373160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:32:26.373160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:32:26.373160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a2ff4862-b9e3-4bfe-a0c5-5e166e70a396 could not be found. May 26 12:32:26.373160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:26.373160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:32:26.373160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:26.373160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:32:26.373160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:32:26.373160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:32:26.373160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:32:26.373160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:32:26.373160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:32:26.373160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:32:26.373160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:32:26.373160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:32:26.373160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 12:32:26.373160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:32:26.373998 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a2ff4862-b9e3-4bfe-a0c5-5e166e70a396 could not be found. May 26 12:32:26.373998 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:26.373998 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:32:26.373998 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:26.373998 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:32:26.373998 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:32:26.373998 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:32:26.373998 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:32:26.373998 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:32:26.373998 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a2ff4862-b9e3-4bfe-a0c5-5e166e70a396 could not be found. May 26 12:32:26.373998 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:32:26.373998 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-29ff81db-448a-45a0-b82b-bb48b7e1bc5a tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] Returning 404 to user: Volume a2ff4862-b9e3-4bfe-a0c5-5e166e70a396 could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:32:26.373998 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-29ff81db-448a-45a0-b82b-bb48b7e1bc5a tempest-VolumesNegativeTest-588098238 tempest-VolumesNegativeTest-588098238-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/a2ff4862-b9e3-4bfe-a0c5-5e166e70a396" status: 404 len: 109 microversion: 2.1 time: 0.077340 May 26 12:32:26.373998 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 6/8] 10.222.0.39 () {58 vars in 1244 bytes} [Thu May 26 12:32:26 2022] GET /compute/v2.1/os-volumes/a2ff4862-b9e3-4bfe-a0c5-5e166e70a396 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:32:28.347824 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-b9a8e74c-b7a9-4973-9549-e5ce1c64625c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Flavor limits 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:32:28.349354 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-b9a8e74c-b7a9-4973-9549-e5ce1c64625c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Image limits 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:32:28.349992 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-b9a8e74c-b7a9-4973-9549-e5ce1c64625c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Flavor pref 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:32:28.350550 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-b9a8e74c-b7a9-4973-9549-e5ce1c64625c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Image pref 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:32:28.351103 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-b9a8e74c-b7a9-4973-9549-e5ce1c64625c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:32:28.376351 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b9a8e74c-b7a9-4973-9549-e5ce1c64625c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:28.381839 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b9a8e74c-b7a9-4973-9549-e5ce1c64625c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:28.383484 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b9a8e74c-b7a9-4973-9549-e5ce1c64625c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:28.384510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b9a8e74c-b7a9-4973-9549-e5ce1c64625c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:28.512550 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.quota [None req-b9a8e74c-b7a9-4973-9549-e5ce1c64625c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Getting quotas for project e7143cd05e47434a9e4babd66167f5ea. Resources: {'cores', 'instances', 'ram'} {{(pid=124134) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:32:28.541941 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.quota [None req-b9a8e74c-b7a9-4973-9549-e5ce1c64625c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Getting quotas for user 900271d533084386b3d7a3072c355e4c and project e7143cd05e47434a9e4babd66167f5ea. Resources: {'cores', 'instances', 'ram'} {{(pid=124134) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:32:28.558155 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b9a8e74c-b7a9-4973-9549-e5ce1c64625c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Going to run 1 instances... {{(pid=124134) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:32:28.562198 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b9a8e74c-b7a9-4973-9549-e5ce1c64625c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:32:28.720345 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b9a8e74c-b7a9-4973-9549-e5ce1c64625c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.601057 May 26 12:32:28.721297 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 3/9] 10.222.0.39 () {60 vars in 1146 bytes} [Thu May 26 12:32:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:32:28.741062 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-8064c31d-00dc-4f91-b92c-03822650dcb2 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:28.742769 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-8064c31d-00dc-4f91-b92c-03822650dcb2 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:29.095132 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-8064c31d-00dc-4f91-b92c-03822650dcb2 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:29.142021 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-8064c31d-00dc-4f91-b92c-03822650dcb2 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1214 microversion: 2.1 time: 0.413923 May 26 12:32:29.144508 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 7/10] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:28 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1214 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:30.175217 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-fd40e056-5a65-4498-b035-cb0a9734f927 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:30.175859 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-fd40e056-5a65-4498-b035-cb0a9734f927 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:30.504587 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-fd40e056-5a65-4498-b035-cb0a9734f927 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:30.548396 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-fd40e056-5a65-4498-b035-cb0a9734f927 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1214 microversion: 2.1 time: 0.379995 May 26 12:32:30.549797 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 4/11] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:30 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1214 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:31.566370 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d294ebb0-24d0-47a6-8904-622432b022d9 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:31.566965 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d294ebb0-24d0-47a6-8904-622432b022d9 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:31.582210 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d294ebb0-24d0-47a6-8904-622432b022d9 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:31.582802 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d294ebb0-24d0-47a6-8904-622432b022d9 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:31.585946 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d294ebb0-24d0-47a6-8904-622432b022d9 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:31.586392 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d294ebb0-24d0-47a6-8904-622432b022d9 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:32.015748 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d294ebb0-24d0-47a6-8904-622432b022d9 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:32.047072 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-d294ebb0-24d0-47a6-8904-622432b022d9 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1210 microversion: 2.1 time: 0.479822 May 26 12:32:32.048264 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 8/12] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:31 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1210 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:33.068155 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-86d594b1-4aed-4464-a9f7-71284814cfb5 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:33.069519 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-86d594b1-4aed-4464-a9f7-71284814cfb5 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:33.094906 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-86d594b1-4aed-4464-a9f7-71284814cfb5 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:33.103681 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-86d594b1-4aed-4464-a9f7-71284814cfb5 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:33.105961 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-86d594b1-4aed-4464-a9f7-71284814cfb5 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:33.113343 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-86d594b1-4aed-4464-a9f7-71284814cfb5 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:33.685949 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-86d594b1-4aed-4464-a9f7-71284814cfb5 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:33.719490 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-86d594b1-4aed-4464-a9f7-71284814cfb5 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1272 microversion: 2.1 time: 0.652788 May 26 12:32:33.720388 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 5/13] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:33 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1272 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:34.741543 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-1341de85-9531-4d8e-98a3-a78f3c1eb34f tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:34.742193 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-1341de85-9531-4d8e-98a3-a78f3c1eb34f tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:34.756899 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1341de85-9531-4d8e-98a3-a78f3c1eb34f tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:34.757355 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1341de85-9531-4d8e-98a3-a78f3c1eb34f tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:34.775330 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1341de85-9531-4d8e-98a3-a78f3c1eb34f tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:34.776155 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1341de85-9531-4d8e-98a3-a78f3c1eb34f tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:35.235129 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-1341de85-9531-4d8e-98a3-a78f3c1eb34f tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:35.243752 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-1341de85-9531-4d8e-98a3-a78f3c1eb34f tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1272 microversion: 2.1 time: 0.506242 May 26 12:32:35.246183 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 9/14] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:34 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1272 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:36.269676 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b83a96fc-74fe-4c12-9ae1-38c322e52c17 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:36.270454 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b83a96fc-74fe-4c12-9ae1-38c322e52c17 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:36.287645 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b83a96fc-74fe-4c12-9ae1-38c322e52c17 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:36.291811 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b83a96fc-74fe-4c12-9ae1-38c322e52c17 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:36.299690 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b83a96fc-74fe-4c12-9ae1-38c322e52c17 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:36.302878 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b83a96fc-74fe-4c12-9ae1-38c322e52c17 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:36.811857 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b83a96fc-74fe-4c12-9ae1-38c322e52c17 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:36.825167 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b83a96fc-74fe-4c12-9ae1-38c322e52c17 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.565122 May 26 12:32:36.838470 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 6/15] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:36 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:37.794203 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-8f8fab84-134d-4e5e-996f-bcd2a5057351 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Action: 'create', calling method: .version_select at 0x7fed33161940>, body: {"keypair": {"name": "tempest-keypair-834799304", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfLnsWR/9lCRjaI/SkGir1PEBzmXCoHQygW0RpSYWKCTv02MmbY8iy5geqyN/pibTQp5+DvhMFawnpIjA1qg42M4rnk5VzIUTe4D+995PAov4xAlLM43NpR+FNudHzDnQ=="}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:32:37.846931 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-c2484b02-c900-49c9-a90a-ac9a7a4d7c09 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:37.848511 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-c2484b02-c900-49c9-a90a-ac9a7a4d7c09 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:37.863006 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c2484b02-c900-49c9-a90a-ac9a7a4d7c09 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:37.863610 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c2484b02-c900-49c9-a90a-ac9a7a4d7c09 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:37.868896 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c2484b02-c900-49c9-a90a-ac9a7a4d7c09 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:37.869667 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c2484b02-c900-49c9-a90a-ac9a7a4d7c09 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:37.973144 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-8f8fab84-134d-4e5e-996f-bcd2a5057351 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Getting quotas for project 7ef656c0ca2943eb965bf10d4e943d27. Resources: {'key_pairs'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:32:38.002720 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-8f8fab84-134d-4e5e-996f-bcd2a5057351 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Getting quotas for user 7b14606965a74c71881595c71bdd2d58 and project 7ef656c0ca2943eb965bf10d4e943d27. Resources: {'key_pairs'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:32:38.169327 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-8f8fab84-134d-4e5e-996f-bcd2a5057351 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.822374 May 26 12:32:38.175628 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 10/16] 10.222.0.39 () {60 vars in 1158 bytes} [Thu May 26 12:32:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:32:38.465976 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell0:SELECT=2 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:38.557198 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c2484b02-c900-49c9-a90a-ac9a7a4d7c09 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:38.570005 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-c2484b02-c900-49c9-a90a-ac9a7a4d7c09 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.726980 May 26 12:32:38.570779 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 7/17] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:37 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:39.592979 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-281cf52d-65cd-4204-ad40-a46734c1a3b6 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:39.594274 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-281cf52d-65cd-4204-ad40-a46734c1a3b6 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:39.609146 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-281cf52d-65cd-4204-ad40-a46734c1a3b6 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:39.609146 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-281cf52d-65cd-4204-ad40-a46734c1a3b6 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:39.609146 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-281cf52d-65cd-4204-ad40-a46734c1a3b6 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:39.609146 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-281cf52d-65cd-4204-ad40-a46734c1a3b6 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:40.221132 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-281cf52d-65cd-4204-ad40-a46734c1a3b6 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:40.236878 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-281cf52d-65cd-4204-ad40-a46734c1a3b6 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.646119 May 26 12:32:40.250059 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 11/18] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:39 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:40.595891 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell0:SELECT=8 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:41.209164 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-787e1335-3eba-4b03-87ad-9874ff912018 req-8330822a-5c8b-4780-8515-f980007cfe5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b01a615-8fbe-4303-a8e0-6146799a92a1", "tag": "cfb303af-9284-4763-8dc5-4ba92ee9dc4b"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:32:41.256296 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-090a3636-d80c-41f8-902b-84a42b226066 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:41.257419 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-787e1335-3eba-4b03-87ad-9874ff912018 req-8330822a-5c8b-4780-8515-f980007cfe5a service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:41.258504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-787e1335-3eba-4b03-87ad-9874ff912018 req-8330822a-5c8b-4780-8515-f980007cfe5a service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:41.259122 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-090a3636-d80c-41f8-902b-84a42b226066 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:41.271077 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-090a3636-d80c-41f8-902b-84a42b226066 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:41.274408 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-090a3636-d80c-41f8-902b-84a42b226066 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:41.283945 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-090a3636-d80c-41f8-902b-84a42b226066 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:41.284867 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-090a3636-d80c-41f8-902b-84a42b226066 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:41.340074 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-787e1335-3eba-4b03-87ad-9874ff912018 req-8330822a-5c8b-4780-8515-f980007cfe5a service nova] Creating event network-changed:cfb303af-9284-4763-8dc5-4ba92ee9dc4b for instance 7b01a615-8fbe-4303-a8e0-6146799a92a1 on hv-cinder-81514 May 26 12:32:41.340763 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-787e1335-3eba-4b03-87ad-9874ff912018 req-8330822a-5c8b-4780-8515-f980007cfe5a service nova] Acquired lock "compute-rpcapi-router" {{(pid=124134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 12:32:41.342878 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b01a4b5c-9608-49ea-bd30-3a5a7f1b8a3e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:41.354396 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b01a4b5c-9608-49ea-bd30-3a5a7f1b8a3e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:41.356137 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b01a4b5c-9608-49ea-bd30-3a5a7f1b8a3e None None] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:41.358486 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b01a4b5c-9608-49ea-bd30-3a5a7f1b8a3e None None] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:41.418435 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.compute.rpcapi [None req-b01a4b5c-9608-49ea-bd30-3a5a7f1b8a3e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 12:32:41.422210 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b01a4b5c-9608-49ea-bd30-3a5a7f1b8a3e None None] Releasing lock "compute-rpcapi-router" {{(pid=124134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 12:32:41.464409 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b01a4b5c-9608-49ea-bd30-3a5a7f1b8a3e None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.873533 May 26 12:32:41.465788 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 8/19] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:32:41.960087 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-090a3636-d80c-41f8-902b-84a42b226066 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:41.971711 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-090a3636-d80c-41f8-902b-84a42b226066 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.720169 May 26 12:32:41.974227 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 12/20] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:41 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:32:43.022217 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6cd00415-2107-4673-b0d6-fb4f8ccd9ad7 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:43.023636 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-6cd00415-2107-4673-b0d6-fb4f8ccd9ad7 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:43.062176 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6cd00415-2107-4673-b0d6-fb4f8ccd9ad7 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:43.068484 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6cd00415-2107-4673-b0d6-fb4f8ccd9ad7 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:43.075054 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6cd00415-2107-4673-b0d6-fb4f8ccd9ad7 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:43.079603 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6cd00415-2107-4673-b0d6-fb4f8ccd9ad7 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:43.959954 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-6cd00415-2107-4673-b0d6-fb4f8ccd9ad7 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:43.969491 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-6cd00415-2107-4673-b0d6-fb4f8ccd9ad7 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.983141 May 26 12:32:43.975078 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 9/21] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:42 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:45.015218 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-9b76be75-52a4-4acc-92d3-739fb896ad8a tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:45.016478 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-9b76be75-52a4-4acc-92d3-739fb896ad8a tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:45.035331 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9b76be75-52a4-4acc-92d3-739fb896ad8a tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:45.047097 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9b76be75-52a4-4acc-92d3-739fb896ad8a tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:45.052077 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9b76be75-52a4-4acc-92d3-739fb896ad8a tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:45.054646 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9b76be75-52a4-4acc-92d3-739fb896ad8a tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:45.417872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-9b76be75-52a4-4acc-92d3-739fb896ad8a tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:45.427919 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-9b76be75-52a4-4acc-92d3-739fb896ad8a tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.439862 May 26 12:32:45.428562 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 13/22] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:44 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:46.358683 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-ebf2a49c-d9e3-46fa-b296-764b83a0113a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1120785987", "imageRef": "7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:32:46.519385 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e430e903-e662-4167-8373-cc4a419ef8a1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Action: 'create', calling method: .version_select at 0x7fed32856ee0>, body: {"keypair": {"name": "tempest-keypair-1023879281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBdLkBvPX9QcJa87VFWZZ09Py7Fdaerqu0+MRJgFvseRG+8slRt3og4psMI+JOFYANsIZ5T8Mb+qLLddb4W76s71wM3EduLNXGvRv9WtjBw14PWORsCXkDBnliAwNtA6g=="}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:32:46.537175 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.network.neutron [None req-ebf2a49c-d9e3-46fa-b296-764b83a0113a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] validate_networks() for [('55df86f9-dea3-4e88-a7f6-b46e44ef14dd', None, None, None, None, None)] {{(pid=124134) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:32:46.573947 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-e430e903-e662-4167-8373-cc4a419ef8a1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Getting quotas for project 978105ae032049cd85c3b1c061d10a24. Resources: {'key_pairs'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:32:46.593648 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-e430e903-e662-4167-8373-cc4a419ef8a1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Getting quotas for user c90e6a7a7265480ca4c817d633da4a1d and project 978105ae032049cd85c3b1c061d10a24. Resources: {'key_pairs'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:32:46.693233 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e430e903-e662-4167-8373-cc4a419ef8a1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.367308 May 26 12:32:46.695510 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 14/23] 10.222.0.39 () {62 vars in 1199 bytes} [Thu May 26 12:32:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 371 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 26 12:32:46.716998 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e5c59e3e-c621-418e-8af2-0f2104d8a166 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:46.721809 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e5c59e3e-c621-418e-8af2-0f2104d8a166 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:46.737518 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e5c59e3e-c621-418e-8af2-0f2104d8a166 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:46.738301 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e5c59e3e-c621-418e-8af2-0f2104d8a166 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:46.741682 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e5c59e3e-c621-418e-8af2-0f2104d8a166 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:46.742461 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e5c59e3e-c621-418e-8af2-0f2104d8a166 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:47.271062 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e5c59e3e-c621-418e-8af2-0f2104d8a166 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:47.284033 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e5c59e3e-c621-418e-8af2-0f2104d8a166 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.584258 May 26 12:32:47.286222 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 15/24] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:46 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:47.304678 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-39a4b431-d1b2-432f-ba61-6b05b8f0815c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-468808278", "imageRef": "7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b932a260-099c-4abe-98f7-c68e5fa9337e"}], "security_groups": [{"name": "tempest-securitygroup--67353546"}], "key_name": "tempest-keypair-834799304", "user_data": "}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:32:47.727397 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.network.neutron [None req-39a4b431-d1b2-432f-ba61-6b05b8f0815c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] validate_networks() for [('b932a260-099c-4abe-98f7-c68e5fa9337e', None, None, None, None, None)] {{(pid=124133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:32:47.950251 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-ebf2a49c-d9e3-46fa-b296-764b83a0113a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Flavor limits 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:32:47.952138 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-ebf2a49c-d9e3-46fa-b296-764b83a0113a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Image limits 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:32:47.953465 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-ebf2a49c-d9e3-46fa-b296-764b83a0113a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Flavor pref 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:32:47.954410 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-ebf2a49c-d9e3-46fa-b296-764b83a0113a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Image pref 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:32:47.955334 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-ebf2a49c-d9e3-46fa-b296-764b83a0113a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:32:47.974541 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ebf2a49c-d9e3-46fa-b296-764b83a0113a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:47.979930 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ebf2a49c-d9e3-46fa-b296-764b83a0113a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:47.980994 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ebf2a49c-d9e3-46fa-b296-764b83a0113a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:47.981766 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ebf2a49c-d9e3-46fa-b296-764b83a0113a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:48.033370 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.quota [None req-ebf2a49c-d9e3-46fa-b296-764b83a0113a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Getting quotas for project d04d37bf7dfc47f3b20a58a3d95c1c2b. Resources: {'cores', 'instances', 'ram'} {{(pid=124134) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:32:48.039199 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.quota [None req-ebf2a49c-d9e3-46fa-b296-764b83a0113a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Getting quotas for user c21602eca99d48d8824c0f5c1693d573 and project d04d37bf7dfc47f3b20a58a3d95c1c2b. Resources: {'cores', 'instances', 'ram'} {{(pid=124134) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:32:48.055107 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-ebf2a49c-d9e3-46fa-b296-764b83a0113a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Going to run 1 instances... {{(pid=124134) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:32:48.060409 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-ebf2a49c-d9e3-46fa-b296-764b83a0113a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:32:48.196511 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-ebf2a49c-d9e3-46fa-b296-764b83a0113a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.169653 May 26 12:32:48.197437 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 10/25] 10.222.0.39 () {60 vars in 1146 bytes} [Thu May 26 12:32:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 2172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:32:48.215133 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-641be740-714a-4679-beae-7b161760f265 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:48.216997 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-641be740-714a-4679-beae-7b161760f265 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:48.458323 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-641be740-714a-4679-beae-7b161760f265 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:48.483737 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-641be740-714a-4679-beae-7b161760f265 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1222 microversion: 2.1 time: 0.273463 May 26 12:32:48.500118 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 11/26] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:48 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1222 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:48.540029 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6360585b-0be5-4e3d-8d90-cbed198e9c14 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:48.556411 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-6360585b-0be5-4e3d-8d90-cbed198e9c14 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:48.578105 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6360585b-0be5-4e3d-8d90-cbed198e9c14 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:48.593319 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6360585b-0be5-4e3d-8d90-cbed198e9c14 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:48.596370 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6360585b-0be5-4e3d-8d90-cbed198e9c14 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:48.596904 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6360585b-0be5-4e3d-8d90-cbed198e9c14 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:49.101516 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-6360585b-0be5-4e3d-8d90-cbed198e9c14 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:49.135689 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-6360585b-0be5-4e3d-8d90-cbed198e9c14 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.629699 May 26 12:32:49.136377 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 12/27] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:48 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:49.151374 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-d3b7a827-9331-4969-8646-00ce41937f56 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-644385596", "imageRef": "7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:32:49.294242 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.network.neutron [None req-d3b7a827-9331-4969-8646-00ce41937f56 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] validate_networks() for [('55df86f9-dea3-4e88-a7f6-b46e44ef14dd', None, None, None, None, None)] {{(pid=124134) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:32:50.461387 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-39a4b431-d1b2-432f-ba61-6b05b8f0815c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Flavor limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:32:50.462624 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-39a4b431-d1b2-432f-ba61-6b05b8f0815c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Image limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:32:50.463652 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-39a4b431-d1b2-432f-ba61-6b05b8f0815c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Flavor pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:32:50.464327 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-39a4b431-d1b2-432f-ba61-6b05b8f0815c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Image pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:32:50.464934 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-39a4b431-d1b2-432f-ba61-6b05b8f0815c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:32:50.478604 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-39a4b431-d1b2-432f-ba61-6b05b8f0815c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:50.479070 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-39a4b431-d1b2-432f-ba61-6b05b8f0815c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:50.480440 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-39a4b431-d1b2-432f-ba61-6b05b8f0815c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:50.481077 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-39a4b431-d1b2-432f-ba61-6b05b8f0815c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:50.527188 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-39a4b431-d1b2-432f-ba61-6b05b8f0815c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Getting quotas for project 7ef656c0ca2943eb965bf10d4e943d27. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:32:50.540576 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-39a4b431-d1b2-432f-ba61-6b05b8f0815c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Getting quotas for user 7b14606965a74c71881595c71bdd2d58 and project 7ef656c0ca2943eb965bf10d4e943d27. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:32:50.564458 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-39a4b431-d1b2-432f-ba61-6b05b8f0815c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Going to run 1 instances... {{(pid=124133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:32:50.568191 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-39a4b431-d1b2-432f-ba61-6b05b8f0815c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:32:50.702446 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-39a4b431-d1b2-432f-ba61-6b05b8f0815c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 3.413782 May 26 12:32:50.709805 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 16/28] 10.222.0.39 () {60 vars in 1146 bytes} [Thu May 26 12:32:47 2022] POST /compute/v2.1/servers => generated 400 bytes in 3423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:32:50.732259 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-37cfef09-f4e0-4a18-91ef-7675c8167019 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:50.733161 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-37cfef09-f4e0-4a18-91ef-7675c8167019 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:50.741066 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-37cfef09-f4e0-4a18-91ef-7675c8167019 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:50.741877 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-37cfef09-f4e0-4a18-91ef-7675c8167019 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:50.742851 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-37cfef09-f4e0-4a18-91ef-7675c8167019 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:50.744414 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-37cfef09-f4e0-4a18-91ef-7675c8167019 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:51.213700 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-37cfef09-f4e0-4a18-91ef-7675c8167019 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:51.226000 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-37cfef09-f4e0-4a18-91ef-7675c8167019 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.514522 May 26 12:32:51.227327 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 17/29] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:50 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:51.235085 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-aecb227e-be19-465e-8d54-62e4035c9456 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-396874114", "imageRef": "7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f4f4055-c859-4f47-a2b3-80b425f2f227"}], "security_groups": [{"name": "tempest-securitygroup--1712531031"}], "key_name": "tempest-keypair-1023879281", "user_data": "}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:32:51.280623 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-d3b7a827-9331-4969-8646-00ce41937f56 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Flavor limits 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:32:51.281311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-d3b7a827-9331-4969-8646-00ce41937f56 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Image limits 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:32:51.282052 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-d3b7a827-9331-4969-8646-00ce41937f56 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Flavor pref 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:32:51.282617 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-d3b7a827-9331-4969-8646-00ce41937f56 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Image pref 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:32:51.283151 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-d3b7a827-9331-4969-8646-00ce41937f56 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:32:51.312181 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d3b7a827-9331-4969-8646-00ce41937f56 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:51.313503 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d3b7a827-9331-4969-8646-00ce41937f56 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:51.314850 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d3b7a827-9331-4969-8646-00ce41937f56 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:51.315620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d3b7a827-9331-4969-8646-00ce41937f56 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:51.361153 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.quota [None req-d3b7a827-9331-4969-8646-00ce41937f56 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Getting quotas for project d04d37bf7dfc47f3b20a58a3d95c1c2b. Resources: {'cores', 'instances', 'ram'} {{(pid=124134) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:32:51.367901 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.quota [None req-d3b7a827-9331-4969-8646-00ce41937f56 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Getting quotas for user c21602eca99d48d8824c0f5c1693d573 and project d04d37bf7dfc47f3b20a58a3d95c1c2b. Resources: {'cores', 'instances', 'ram'} {{(pid=124134) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:32:51.387525 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-d3b7a827-9331-4969-8646-00ce41937f56 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Going to run 1 instances... {{(pid=124134) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:32:51.390938 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-d3b7a827-9331-4969-8646-00ce41937f56 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:32:51.428852 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.network.neutron [None req-aecb227e-be19-465e-8d54-62e4035c9456 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] validate_networks() for [('2f4f4055-c859-4f47-a2b3-80b425f2f227', None, None, None, None, None)] {{(pid=124133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:32:51.473782 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-d3b7a827-9331-4969-8646-00ce41937f56 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.327506 May 26 12:32:51.484268 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 13/30] 10.222.0.39 () {60 vars in 1146 bytes} [Thu May 26 12:32:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 2347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:32:51.490512 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-9fc723b2-7b8d-4657-8f64-042128abc73d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:51.491666 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-9fc723b2-7b8d-4657-8f64-042128abc73d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:51.670143 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-9fc723b2-7b8d-4657-8f64-042128abc73d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:51.683796 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-9fc723b2-7b8d-4657-8f64-042128abc73d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1240 microversion: 2.1 time: 0.197749 May 26 12:32:51.692779 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 14/31] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:51 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1240 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:51.760678 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-cd78ac5e-461e-4d6b-8d44-1ef4bf59019c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:51.761750 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-cd78ac5e-461e-4d6b-8d44-1ef4bf59019c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:52.372420 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-cd78ac5e-461e-4d6b-8d44-1ef4bf59019c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:52.398198 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-cd78ac5e-461e-4d6b-8d44-1ef4bf59019c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1221 microversion: 2.1 time: 0.704078 May 26 12:32:52.399267 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 15/32] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:51 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1221 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:52.407652 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-2a3b19c5-8a2e-4351-8505-ad2723fea4aa tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:52.409187 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-2a3b19c5-8a2e-4351-8505-ad2723fea4aa tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:52.420183 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=9 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:52.423490 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2a3b19c5-8a2e-4351-8505-ad2723fea4aa tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:52.424125 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2a3b19c5-8a2e-4351-8505-ad2723fea4aa tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:52.425306 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2a3b19c5-8a2e-4351-8505-ad2723fea4aa tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:52.425891 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2a3b19c5-8a2e-4351-8505-ad2723fea4aa tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:52.432078 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=41 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:53.375557 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2a3b19c5-8a2e-4351-8505-ad2723fea4aa tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:53.385327 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-2a3b19c5-8a2e-4351-8505-ad2723fea4aa tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.984514 May 26 12:32:53.392424 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 16/33] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:52 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:53.410061 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-9e9879a0-b78f-4b39-a2f7-bdc8dad19b8a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:53.419153 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-9e9879a0-b78f-4b39-a2f7-bdc8dad19b8a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:53.429554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9e9879a0-b78f-4b39-a2f7-bdc8dad19b8a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:53.430016 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9e9879a0-b78f-4b39-a2f7-bdc8dad19b8a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:53.430819 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9e9879a0-b78f-4b39-a2f7-bdc8dad19b8a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:53.444641 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9e9879a0-b78f-4b39-a2f7-bdc8dad19b8a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:53.609924 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-9e9879a0-b78f-4b39-a2f7-bdc8dad19b8a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:53.645342 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-9e9879a0-b78f-4b39-a2f7-bdc8dad19b8a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1292 microversion: 2.1 time: 0.250983 May 26 12:32:53.657320 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-aecb227e-be19-465e-8d54-62e4035c9456 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Flavor limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:32:53.658632 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-aecb227e-be19-465e-8d54-62e4035c9456 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Image limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:32:53.659514 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-aecb227e-be19-465e-8d54-62e4035c9456 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Flavor pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:32:53.660447 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-aecb227e-be19-465e-8d54-62e4035c9456 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Image pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:32:53.660785 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 17/34] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:53 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1292 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:53.661467 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-aecb227e-be19-465e-8d54-62e4035c9456 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:32:53.690791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-d9c352c1-15f9-48f8-a943-c83f59a1ecba tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:53.691419 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-d9c352c1-15f9-48f8-a943-c83f59a1ecba tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:53.694108 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-aecb227e-be19-465e-8d54-62e4035c9456 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:53.696353 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-aecb227e-be19-465e-8d54-62e4035c9456 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:53.698361 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-aecb227e-be19-465e-8d54-62e4035c9456 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:53.700029 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-aecb227e-be19-465e-8d54-62e4035c9456 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:53.737249 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d9c352c1-15f9-48f8-a943-c83f59a1ecba tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:53.737558 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-aecb227e-be19-465e-8d54-62e4035c9456 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Getting quotas for project 978105ae032049cd85c3b1c061d10a24. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:32:53.737703 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d9c352c1-15f9-48f8-a943-c83f59a1ecba tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:53.738661 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d9c352c1-15f9-48f8-a943-c83f59a1ecba tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:53.739250 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d9c352c1-15f9-48f8-a943-c83f59a1ecba tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:53.743188 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-aecb227e-be19-465e-8d54-62e4035c9456 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Getting quotas for user c90e6a7a7265480ca4c817d633da4a1d and project 978105ae032049cd85c3b1c061d10a24. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:32:53.769021 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-aecb227e-be19-465e-8d54-62e4035c9456 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Going to run 1 instances... {{(pid=124133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:32:53.771595 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-aecb227e-be19-465e-8d54-62e4035c9456 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:32:53.845445 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-aecb227e-be19-465e-8d54-62e4035c9456 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.616496 May 26 12:32:53.846562 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 18/35] 10.222.0.39 () {62 vars in 1187 bytes} [Thu May 26 12:32:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 2619 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 12:32:53.867300 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d8842180-18f6-4f1c-b86f-dcc5f1ccf725 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:53.873807 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d8842180-18f6-4f1c-b86f-dcc5f1ccf725 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:54.195701 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d9c352c1-15f9-48f8-a943-c83f59a1ecba tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:54.213682 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-d9c352c1-15f9-48f8-a943-c83f59a1ecba tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1225 microversion: 2.1 time: 0.545721 May 26 12:32:54.215244 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 18/36] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:53 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1225 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:54.220228 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d8842180-18f6-4f1c-b86f-dcc5f1ccf725 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:54.228058 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d8842180-18f6-4f1c-b86f-dcc5f1ccf725 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:54.235386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d8842180-18f6-4f1c-b86f-dcc5f1ccf725 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:54.237943 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-d8842180-18f6-4f1c-b86f-dcc5f1ccf725 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1281 microversion: 2.20 time: 0.380106 May 26 12:32:54.238594 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 19/37] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:32:53 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1281 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:32:54.417056 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-1f035e40-4f5b-400b-b5c2-37005225823e tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:54.418952 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-1f035e40-4f5b-400b-b5c2-37005225823e tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:54.435680 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1f035e40-4f5b-400b-b5c2-37005225823e tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:54.450680 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1f035e40-4f5b-400b-b5c2-37005225823e tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:54.456254 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1f035e40-4f5b-400b-b5c2-37005225823e tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:54.456973 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1f035e40-4f5b-400b-b5c2-37005225823e tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:54.674737 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-adcc5bd8-e6ea-4642-94de-45320cbcae8f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:54.675774 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-adcc5bd8-e6ea-4642-94de-45320cbcae8f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:54.681529 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-1f035e40-4f5b-400b-b5c2-37005225823e tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:54.682184 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-adcc5bd8-e6ea-4642-94de-45320cbcae8f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:54.683216 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-adcc5bd8-e6ea-4642-94de-45320cbcae8f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:54.687578 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-adcc5bd8-e6ea-4642-94de-45320cbcae8f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:54.690959 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-adcc5bd8-e6ea-4642-94de-45320cbcae8f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:54.701041 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-1f035e40-4f5b-400b-b5c2-37005225823e tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.290069 May 26 12:32:54.707855 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 19/38] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:54 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:54.838083 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-adcc5bd8-e6ea-4642-94de-45320cbcae8f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:54.847626 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-adcc5bd8-e6ea-4642-94de-45320cbcae8f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1292 microversion: 2.1 time: 0.177279 May 26 12:32:54.848254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 20/39] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:54 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1292 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:55.235670 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-3657ea3c-7f32-4544-a288-cb170307e256 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:55.236419 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-3657ea3c-7f32-4544-a288-cb170307e256 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:55.243965 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3657ea3c-7f32-4544-a288-cb170307e256 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:55.245028 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3657ea3c-7f32-4544-a288-cb170307e256 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:55.246331 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3657ea3c-7f32-4544-a288-cb170307e256 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:55.247169 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3657ea3c-7f32-4544-a288-cb170307e256 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:55.260362 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-7a9b79bb-b064-4184-bef5-28ebbcf48cea tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:55.261756 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-7a9b79bb-b064-4184-bef5-28ebbcf48cea tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:55.264364 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=8 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:55.282358 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7a9b79bb-b064-4184-bef5-28ebbcf48cea tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:55.283235 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7a9b79bb-b064-4184-bef5-28ebbcf48cea tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:55.284225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7a9b79bb-b064-4184-bef5-28ebbcf48cea tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:55.284824 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7a9b79bb-b064-4184-bef5-28ebbcf48cea tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:55.288285 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=53 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:55.341859 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-3657ea3c-7f32-4544-a288-cb170307e256 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:55.352289 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-3657ea3c-7f32-4544-a288-cb170307e256 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1225 microversion: 2.1 time: 0.121904 May 26 12:32:55.357178 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 20/40] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:55 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1225 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:55.373526 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-7a9b79bb-b064-4184-bef5-28ebbcf48cea tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:55.383741 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-7a9b79bb-b064-4184-bef5-28ebbcf48cea tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:55.386787 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-7a9b79bb-b064-4184-bef5-28ebbcf48cea tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:55.389335 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-7a9b79bb-b064-4184-bef5-28ebbcf48cea tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1285 microversion: 2.20 time: 0.132580 May 26 12:32:55.390336 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 21/41] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:32:55 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:32:55.725083 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-66580ab9-95e2-4e90-894e-b605dd369691 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:55.725691 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-66580ab9-95e2-4e90-894e-b605dd369691 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:55.734684 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-66580ab9-95e2-4e90-894e-b605dd369691 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:55.736035 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-66580ab9-95e2-4e90-894e-b605dd369691 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:55.737075 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-66580ab9-95e2-4e90-894e-b605dd369691 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:55.737833 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-66580ab9-95e2-4e90-894e-b605dd369691 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:55.870228 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-37aea333-c03c-43b2-b99b-ed4f76abe222 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:55.870228 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-37aea333-c03c-43b2-b99b-ed4f76abe222 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:55.896064 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-37aea333-c03c-43b2-b99b-ed4f76abe222 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:55.896502 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-37aea333-c03c-43b2-b99b-ed4f76abe222 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:55.897531 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-37aea333-c03c-43b2-b99b-ed4f76abe222 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:55.897981 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-37aea333-c03c-43b2-b99b-ed4f76abe222 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:56.003194 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-37aea333-c03c-43b2-b99b-ed4f76abe222 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:56.012259 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-66580ab9-95e2-4e90-894e-b605dd369691 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:56.014152 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-37aea333-c03c-43b2-b99b-ed4f76abe222 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1292 microversion: 2.1 time: 0.150361 May 26 12:32:56.022561 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 22/42] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:55 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1292 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:32:56.023177 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-66580ab9-95e2-4e90-894e-b605dd369691 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.301691 May 26 12:32:56.030173 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 21/43] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:55 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:56.382309 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ff1bca02-8602-47ff-9ace-9e976c493ae5 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:56.383246 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ff1bca02-8602-47ff-9ace-9e976c493ae5 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:56.403873 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ff1bca02-8602-47ff-9ace-9e976c493ae5 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:56.405132 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ff1bca02-8602-47ff-9ace-9e976c493ae5 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:56.406980 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ff1bca02-8602-47ff-9ace-9e976c493ae5 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:56.407841 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ff1bca02-8602-47ff-9ace-9e976c493ae5 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:56.410809 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-32c021b8-be9a-4acf-a239-3e2305aef536 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:56.411662 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-32c021b8-be9a-4acf-a239-3e2305aef536 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:56.425799 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-32c021b8-be9a-4acf-a239-3e2305aef536 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:56.426416 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-32c021b8-be9a-4acf-a239-3e2305aef536 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:56.427600 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-32c021b8-be9a-4acf-a239-3e2305aef536 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:56.430396 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-32c021b8-be9a-4acf-a239-3e2305aef536 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:56.540833 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ff1bca02-8602-47ff-9ace-9e976c493ae5 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:56.549654 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ff1bca02-8602-47ff-9ace-9e976c493ae5 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1225 microversion: 2.1 time: 0.178667 May 26 12:32:56.550236 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 23/44] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:56 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1225 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:32:56.566093 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-32c021b8-be9a-4acf-a239-3e2305aef536 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:56.576657 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-32c021b8-be9a-4acf-a239-3e2305aef536 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:56.578685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-32c021b8-be9a-4acf-a239-3e2305aef536 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:56.580023 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-32c021b8-be9a-4acf-a239-3e2305aef536 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1285 microversion: 2.20 time: 0.174553 May 26 12:32:56.580677 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 22/45] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:32:56 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:32:57.041637 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-58de9b03-4cbb-474d-b6f1-9cdd51bb06ae tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:57.042980 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-58de9b03-4cbb-474d-b6f1-9cdd51bb06ae tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:57.051986 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-58de9b03-4cbb-474d-b6f1-9cdd51bb06ae tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:57.053106 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-58de9b03-4cbb-474d-b6f1-9cdd51bb06ae tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:57.053844 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-58de9b03-4cbb-474d-b6f1-9cdd51bb06ae tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:57.054638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-58de9b03-4cbb-474d-b6f1-9cdd51bb06ae tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:57.055869 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-a7d922f7-ad08-4244-99df-941eaf255ba5 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:57.058356 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-a7d922f7-ad08-4244-99df-941eaf255ba5 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:57.070398 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a7d922f7-ad08-4244-99df-941eaf255ba5 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:57.071355 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a7d922f7-ad08-4244-99df-941eaf255ba5 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:57.072945 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a7d922f7-ad08-4244-99df-941eaf255ba5 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:57.074487 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a7d922f7-ad08-4244-99df-941eaf255ba5 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:57.166972 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-58de9b03-4cbb-474d-b6f1-9cdd51bb06ae tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:57.184295 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-58de9b03-4cbb-474d-b6f1-9cdd51bb06ae tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1292 microversion: 2.1 time: 0.147727 May 26 12:32:57.185458 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 24/46] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:57 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1292 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:57.286525 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a7d922f7-ad08-4244-99df-941eaf255ba5 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:57.297730 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-a7d922f7-ad08-4244-99df-941eaf255ba5 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.247343 May 26 12:32:57.297730 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 23/47] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:57 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:32:57.566600 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-9618e3fa-d8ae-477c-b3df-22df03bdc4fe tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:57.567209 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-9618e3fa-d8ae-477c-b3df-22df03bdc4fe tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:57.573773 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9618e3fa-d8ae-477c-b3df-22df03bdc4fe tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:57.574352 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9618e3fa-d8ae-477c-b3df-22df03bdc4fe tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:57.575395 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9618e3fa-d8ae-477c-b3df-22df03bdc4fe tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:57.575847 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9618e3fa-d8ae-477c-b3df-22df03bdc4fe tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:57.599671 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-501323d4-3261-465d-ad9b-17ea4cf842bd tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:57.600551 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-501323d4-3261-465d-ad9b-17ea4cf842bd tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:57.607708 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-501323d4-3261-465d-ad9b-17ea4cf842bd tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:57.608162 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-501323d4-3261-465d-ad9b-17ea4cf842bd tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:57.608982 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-501323d4-3261-465d-ad9b-17ea4cf842bd tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:57.609423 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-501323d4-3261-465d-ad9b-17ea4cf842bd tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:57.670553 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-9618e3fa-d8ae-477c-b3df-22df03bdc4fe tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:57.688775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-9618e3fa-d8ae-477c-b3df-22df03bdc4fe tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1225 microversion: 2.1 time: 0.124460 May 26 12:32:57.690472 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 25/48] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:57 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1225 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:57.708546 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-501323d4-3261-465d-ad9b-17ea4cf842bd tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:57.719646 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-501323d4-3261-465d-ad9b-17ea4cf842bd tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:57.721432 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-501323d4-3261-465d-ad9b-17ea4cf842bd tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:57.723640 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-501323d4-3261-465d-ad9b-17ea4cf842bd tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1285 microversion: 2.20 time: 0.128533 May 26 12:32:57.724202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 24/49] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:32:57 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:32:58.202264 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-1501a5fb-c3a6-44b2-ae6b-54745c2dc276 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:58.203158 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-1501a5fb-c3a6-44b2-ae6b-54745c2dc276 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:58.210028 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1501a5fb-c3a6-44b2-ae6b-54745c2dc276 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:58.210490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1501a5fb-c3a6-44b2-ae6b-54745c2dc276 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:58.211263 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1501a5fb-c3a6-44b2-ae6b-54745c2dc276 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:58.211720 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1501a5fb-c3a6-44b2-ae6b-54745c2dc276 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:58.277588 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-1501a5fb-c3a6-44b2-ae6b-54745c2dc276 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:58.285233 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-1501a5fb-c3a6-44b2-ae6b-54745c2dc276 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1292 microversion: 2.1 time: 0.087562 May 26 12:32:58.285798 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 26/50] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:58 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1292 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:58.311780 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-a80cf4f1-e590-4a0b-a168-a6fa3f33004d tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:58.312418 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-a80cf4f1-e590-4a0b-a168-a6fa3f33004d tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:58.318500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a80cf4f1-e590-4a0b-a168-a6fa3f33004d tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:58.318958 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a80cf4f1-e590-4a0b-a168-a6fa3f33004d tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:58.319721 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a80cf4f1-e590-4a0b-a168-a6fa3f33004d tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:58.320166 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a80cf4f1-e590-4a0b-a168-a6fa3f33004d tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:58.452211 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a80cf4f1-e590-4a0b-a168-a6fa3f33004d tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:58.459512 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-a80cf4f1-e590-4a0b-a168-a6fa3f33004d tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.152149 May 26 12:32:58.460057 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 25/51] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:58 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:58.713675 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d10a1459-acd3-4b93-b773-a01cd0fb4728 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:58.715071 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d10a1459-acd3-4b93-b773-a01cd0fb4728 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:58.721788 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d10a1459-acd3-4b93-b773-a01cd0fb4728 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:58.722236 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d10a1459-acd3-4b93-b773-a01cd0fb4728 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:58.723016 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d10a1459-acd3-4b93-b773-a01cd0fb4728 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:58.723446 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d10a1459-acd3-4b93-b773-a01cd0fb4728 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:58.742723 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-c69b7d78-30a5-4549-8b9a-174a969f0c1c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:58.743362 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-c69b7d78-30a5-4549-8b9a-174a969f0c1c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:58.749620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c69b7d78-30a5-4549-8b9a-174a969f0c1c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:58.750077 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c69b7d78-30a5-4549-8b9a-174a969f0c1c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:58.750841 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c69b7d78-30a5-4549-8b9a-174a969f0c1c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:58.751283 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c69b7d78-30a5-4549-8b9a-174a969f0c1c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:58.788811 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d10a1459-acd3-4b93-b773-a01cd0fb4728 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:58.797022 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-d10a1459-acd3-4b93-b773-a01cd0fb4728 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1225 microversion: 2.1 time: 0.087143 May 26 12:32:58.797593 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 27/52] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:58 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:58.816067 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c69b7d78-30a5-4549-8b9a-174a969f0c1c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:58.824701 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c69b7d78-30a5-4549-8b9a-174a969f0c1c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:58.826268 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c69b7d78-30a5-4549-8b9a-174a969f0c1c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:58.827363 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-c69b7d78-30a5-4549-8b9a-174a969f0c1c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1285 microversion: 2.20 time: 0.088501 May 26 12:32:58.827904 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 26/53] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:32:58 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:32:59.302858 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e3fc187b-7edf-43cb-b937-fb4dbc86d6a7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:59.303364 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e3fc187b-7edf-43cb-b937-fb4dbc86d6a7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:59.309485 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e3fc187b-7edf-43cb-b937-fb4dbc86d6a7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:59.309933 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e3fc187b-7edf-43cb-b937-fb4dbc86d6a7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:59.310679 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e3fc187b-7edf-43cb-b937-fb4dbc86d6a7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:59.311112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e3fc187b-7edf-43cb-b937-fb4dbc86d6a7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:59.371398 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e3fc187b-7edf-43cb-b937-fb4dbc86d6a7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:59.378672 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e3fc187b-7edf-43cb-b937-fb4dbc86d6a7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1292 microversion: 2.1 time: 0.079759 May 26 12:32:59.379225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 28/54] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:59 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1292 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:59.481787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-ca213d9e-1b00-4a10-b547-a5447c39ff37 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:59.482375 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-ca213d9e-1b00-4a10-b547-a5447c39ff37 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:59.498772 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ca213d9e-1b00-4a10-b547-a5447c39ff37 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:59.499279 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ca213d9e-1b00-4a10-b547-a5447c39ff37 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:59.500063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ca213d9e-1b00-4a10-b547-a5447c39ff37 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:59.500500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ca213d9e-1b00-4a10-b547-a5447c39ff37 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:59.750779 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ca213d9e-1b00-4a10-b547-a5447c39ff37 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:32:59.763457 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-ca213d9e-1b00-4a10-b547-a5447c39ff37 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.289209 May 26 12:32:59.764116 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 27/55] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:59 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:32:59.814654 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d951965c-2277-48f1-bd23-1363350ef1df tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:59.815535 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d951965c-2277-48f1-bd23-1363350ef1df tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:59.824315 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d951965c-2277-48f1-bd23-1363350ef1df tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:59.824688 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d951965c-2277-48f1-bd23-1363350ef1df tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:59.825820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d951965c-2277-48f1-bd23-1363350ef1df tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:59.826342 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d951965c-2277-48f1-bd23-1363350ef1df tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:59.850189 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-55306be8-d8fd-45f8-8497-35bb91a0ef69 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:32:59.850816 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-55306be8-d8fd-45f8-8497-35bb91a0ef69 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:32:59.864025 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-55306be8-d8fd-45f8-8497-35bb91a0ef69 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:59.866774 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-55306be8-d8fd-45f8-8497-35bb91a0ef69 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:59.872086 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-55306be8-d8fd-45f8-8497-35bb91a0ef69 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:32:59.872086 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-55306be8-d8fd-45f8-8497-35bb91a0ef69 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:32:59.998977 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d951965c-2277-48f1-bd23-1363350ef1df tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:00.013996 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-d951965c-2277-48f1-bd23-1363350ef1df tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1217 microversion: 2.1 time: 0.202963 May 26 12:33:00.017877 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 29/56] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:32:59 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1217 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:00.074948 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-55306be8-d8fd-45f8-8497-35bb91a0ef69 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:00.088507 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-55306be8-d8fd-45f8-8497-35bb91a0ef69 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:00.092263 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-55306be8-d8fd-45f8-8497-35bb91a0ef69 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:00.093753 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-55306be8-d8fd-45f8-8497-35bb91a0ef69 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1277 microversion: 2.20 time: 0.251167 May 26 12:33:00.094746 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 28/57] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:32:59 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1277 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:00.395635 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-77874e87-2020-452f-8543-fd91f0b1dbd5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:00.396141 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-77874e87-2020-452f-8543-fd91f0b1dbd5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:00.402761 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-77874e87-2020-452f-8543-fd91f0b1dbd5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:00.403213 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-77874e87-2020-452f-8543-fd91f0b1dbd5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:00.403984 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-77874e87-2020-452f-8543-fd91f0b1dbd5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:00.404423 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-77874e87-2020-452f-8543-fd91f0b1dbd5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:00.475466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-77874e87-2020-452f-8543-fd91f0b1dbd5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:00.483496 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-77874e87-2020-452f-8543-fd91f0b1dbd5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1298 microversion: 2.1 time: 0.091844 May 26 12:33:00.484070 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 30/58] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:00 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:00.783273 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-c44f1483-0b07-4539-9589-83daec43fe20 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:00.784541 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-c44f1483-0b07-4539-9589-83daec43fe20 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:00.791963 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c44f1483-0b07-4539-9589-83daec43fe20 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:00.793607 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c44f1483-0b07-4539-9589-83daec43fe20 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:00.794399 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c44f1483-0b07-4539-9589-83daec43fe20 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:00.794841 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c44f1483-0b07-4539-9589-83daec43fe20 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:00.946009 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c44f1483-0b07-4539-9589-83daec43fe20 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:00.953451 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-c44f1483-0b07-4539-9589-83daec43fe20 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.174518 May 26 12:33:00.954006 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 29/59] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:00 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:01.035336 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-9212d21a-49f5-401b-a8d1-4002ec8d0798 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:01.035941 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-9212d21a-49f5-401b-a8d1-4002ec8d0798 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:01.042576 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9212d21a-49f5-401b-a8d1-4002ec8d0798 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:01.043122 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9212d21a-49f5-401b-a8d1-4002ec8d0798 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:01.043895 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9212d21a-49f5-401b-a8d1-4002ec8d0798 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:01.044342 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9212d21a-49f5-401b-a8d1-4002ec8d0798 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:01.113058 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-cb862332-c7b9-4991-8146-f5c4676af83d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:01.113910 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-cb862332-c7b9-4991-8146-f5c4676af83d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:01.117750 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-9212d21a-49f5-401b-a8d1-4002ec8d0798 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:01.120504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cb862332-c7b9-4991-8146-f5c4676af83d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:01.121236 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cb862332-c7b9-4991-8146-f5c4676af83d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:01.122832 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cb862332-c7b9-4991-8146-f5c4676af83d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:01.122832 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cb862332-c7b9-4991-8146-f5c4676af83d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:01.125716 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-9212d21a-49f5-401b-a8d1-4002ec8d0798 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1273 microversion: 2.1 time: 0.094145 May 26 12:33:01.126365 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 31/60] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:01 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1273 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:01.189563 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-cb862332-c7b9-4991-8146-f5c4676af83d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:01.199603 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-cb862332-c7b9-4991-8146-f5c4676af83d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:01.201402 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-cb862332-c7b9-4991-8146-f5c4676af83d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:01.202737 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-cb862332-c7b9-4991-8146-f5c4676af83d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1333 microversion: 2.20 time: 0.093886 May 26 12:33:01.203301 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 30/61] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:01 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1333 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:33:01.502430 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-96a3f8e8-ced8-4b81-80ed-93935edad156 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:01.504083 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-96a3f8e8-ced8-4b81-80ed-93935edad156 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:01.511508 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-96a3f8e8-ced8-4b81-80ed-93935edad156 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:01.512029 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-96a3f8e8-ced8-4b81-80ed-93935edad156 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:01.512923 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-96a3f8e8-ced8-4b81-80ed-93935edad156 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:01.513913 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-96a3f8e8-ced8-4b81-80ed-93935edad156 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:01.600532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-96a3f8e8-ced8-4b81-80ed-93935edad156 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:01.610047 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-96a3f8e8-ced8-4b81-80ed-93935edad156 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1298 microversion: 2.1 time: 0.112526 May 26 12:33:01.610751 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 32/62] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:01 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1298 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:01.973443 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-81c410d1-0a6c-4749-b2ba-c4c94da9b7b7 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:01.974205 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-81c410d1-0a6c-4749-b2ba-c4c94da9b7b7 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:01.988434 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell0:SELECT=6 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:01.997633 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-81c410d1-0a6c-4749-b2ba-c4c94da9b7b7 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:01.998186 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-81c410d1-0a6c-4749-b2ba-c4c94da9b7b7 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:01.999192 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-81c410d1-0a6c-4749-b2ba-c4c94da9b7b7 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:01.999657 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-81c410d1-0a6c-4749-b2ba-c4c94da9b7b7 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:02.147216 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-9ff2c4c5-128c-4536-9289-7c4b1e75c0ba tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:02.148191 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-9ff2c4c5-128c-4536-9289-7c4b1e75c0ba tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:02.161037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9ff2c4c5-128c-4536-9289-7c4b1e75c0ba tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:02.161713 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9ff2c4c5-128c-4536-9289-7c4b1e75c0ba tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:02.163257 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9ff2c4c5-128c-4536-9289-7c4b1e75c0ba tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:02.163715 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9ff2c4c5-128c-4536-9289-7c4b1e75c0ba tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:02.278392 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-9ff2c4c5-128c-4536-9289-7c4b1e75c0ba tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:02.297371 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-81c410d1-0a6c-4749-b2ba-c4c94da9b7b7 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:02.306507 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-9ff2c4c5-128c-4536-9289-7c4b1e75c0ba tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1273 microversion: 2.1 time: 0.165489 May 26 12:33:02.315219 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-81c410d1-0a6c-4749-b2ba-c4c94da9b7b7 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.342279 May 26 12:33:02.315219 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 31/63] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:01 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:02.318239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-0434d7e1-c258-4d9b-a5ef-2f562b3ff5ff tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:02.319461 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-0434d7e1-c258-4d9b-a5ef-2f562b3ff5ff tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:02.321677 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 33/64] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:02 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1273 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:02.328547 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0434d7e1-c258-4d9b-a5ef-2f562b3ff5ff tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:02.329158 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0434d7e1-c258-4d9b-a5ef-2f562b3ff5ff tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:02.330171 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0434d7e1-c258-4d9b-a5ef-2f562b3ff5ff tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:02.330801 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0434d7e1-c258-4d9b-a5ef-2f562b3ff5ff tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:02.393216 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell0:SELECT=18 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:02.434883 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-0434d7e1-c258-4d9b-a5ef-2f562b3ff5ff tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:02.437812 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=100 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:02.446302 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-0434d7e1-c258-4d9b-a5ef-2f562b3ff5ff tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:02.449071 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-0434d7e1-c258-4d9b-a5ef-2f562b3ff5ff tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:02.450463 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-0434d7e1-c258-4d9b-a5ef-2f562b3ff5ff tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1333 microversion: 2.20 time: 0.137366 May 26 12:33:02.451096 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 32/65] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:02 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1333 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:02.629308 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-7a3f06ae-c2a7-4c7b-b617-cf9de9e9d1a5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:02.630974 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-7a3f06ae-c2a7-4c7b-b617-cf9de9e9d1a5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:02.640486 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7a3f06ae-c2a7-4c7b-b617-cf9de9e9d1a5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:02.640979 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7a3f06ae-c2a7-4c7b-b617-cf9de9e9d1a5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:02.641800 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7a3f06ae-c2a7-4c7b-b617-cf9de9e9d1a5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:02.642251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7a3f06ae-c2a7-4c7b-b617-cf9de9e9d1a5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:02.728585 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-7a3f06ae-c2a7-4c7b-b617-cf9de9e9d1a5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:02.738704 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-7a3f06ae-c2a7-4c7b-b617-cf9de9e9d1a5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1298 microversion: 2.1 time: 0.113942 May 26 12:33:02.739341 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 34/66] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:02 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1298 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:03.338318 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-32a1cde0-27d1-429d-8926-a3e33d090a13 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:03.340474 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-32a1cde0-27d1-429d-8926-a3e33d090a13 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:03.343523 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-4beb441f-7ce1-4fd1-8cee-f36b0fc8833f tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:03.345743 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-4beb441f-7ce1-4fd1-8cee-f36b0fc8833f tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:03.358067 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4beb441f-7ce1-4fd1-8cee-f36b0fc8833f tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:03.358535 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4beb441f-7ce1-4fd1-8cee-f36b0fc8833f tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:03.359330 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4beb441f-7ce1-4fd1-8cee-f36b0fc8833f tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:03.360083 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4beb441f-7ce1-4fd1-8cee-f36b0fc8833f tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:03.363145 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-32a1cde0-27d1-429d-8926-a3e33d090a13 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:03.363918 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-32a1cde0-27d1-429d-8926-a3e33d090a13 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:03.364767 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-32a1cde0-27d1-429d-8926-a3e33d090a13 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:03.365215 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-32a1cde0-27d1-429d-8926-a3e33d090a13 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:03.496402 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-32a1cde0-27d1-429d-8926-a3e33d090a13 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:03.506635 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-32a1cde0-27d1-429d-8926-a3e33d090a13 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1273 microversion: 2.1 time: 0.174423 May 26 12:33:03.518057 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 33/67] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:03 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1273 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:03.524337 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-16b48a4c-56f4-491d-abc4-54189efffc82 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:03.525236 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-16b48a4c-56f4-491d-abc4-54189efffc82 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:03.537412 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-16b48a4c-56f4-491d-abc4-54189efffc82 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:03.538545 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-16b48a4c-56f4-491d-abc4-54189efffc82 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:03.539652 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-16b48a4c-56f4-491d-abc4-54189efffc82 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:03.540149 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-16b48a4c-56f4-491d-abc4-54189efffc82 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:03.606231 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-4beb441f-7ce1-4fd1-8cee-f36b0fc8833f tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:03.616531 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-4beb441f-7ce1-4fd1-8cee-f36b0fc8833f tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.281571 May 26 12:33:03.618230 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 35/68] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:03 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:03.630649 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-16b48a4c-56f4-491d-abc4-54189efffc82 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:03.642531 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-16b48a4c-56f4-491d-abc4-54189efffc82 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:03.643575 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-16b48a4c-56f4-491d-abc4-54189efffc82 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:03.644764 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-16b48a4c-56f4-491d-abc4-54189efffc82 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1333 microversion: 2.20 time: 0.125282 May 26 12:33:03.645313 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 34/69] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:03 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1333 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:03.767902 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-5319f7b2-d403-40e4-b59f-77b38a7e4109 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:03.768823 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-5319f7b2-d403-40e4-b59f-77b38a7e4109 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:03.788881 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=4 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:03.793488 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5319f7b2-d403-40e4-b59f-77b38a7e4109 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:03.799074 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5319f7b2-d403-40e4-b59f-77b38a7e4109 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:03.800769 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5319f7b2-d403-40e4-b59f-77b38a7e4109 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:03.801447 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5319f7b2-d403-40e4-b59f-77b38a7e4109 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:03.903361 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-5319f7b2-d403-40e4-b59f-77b38a7e4109 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:03.909771 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-5319f7b2-d403-40e4-b59f-77b38a7e4109 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1298 microversion: 2.1 time: 0.153963 May 26 12:33:03.910810 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 36/70] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:03 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1298 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:04.525571 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-23239159-9910-4528-b7aa-2010f026f86b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:04.527459 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-23239159-9910-4528-b7aa-2010f026f86b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:04.537367 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-23239159-9910-4528-b7aa-2010f026f86b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:04.538178 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-23239159-9910-4528-b7aa-2010f026f86b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:04.540416 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-23239159-9910-4528-b7aa-2010f026f86b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:04.541103 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-23239159-9910-4528-b7aa-2010f026f86b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:04.643468 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-2cd77228-b89c-4034-9d89-27829b189276 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:04.645773 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-2cd77228-b89c-4034-9d89-27829b189276 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:04.657557 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=24 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:04.688068 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2cd77228-b89c-4034-9d89-27829b189276 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:04.691284 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2cd77228-b89c-4034-9d89-27829b189276 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:04.695895 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2cd77228-b89c-4034-9d89-27829b189276 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:04.698636 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2cd77228-b89c-4034-9d89-27829b189276 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:04.717286 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-23239159-9910-4528-b7aa-2010f026f86b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:04.750231 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-23239159-9910-4528-b7aa-2010f026f86b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1291 microversion: 2.1 time: 0.226671 May 26 12:33:04.769907 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 35/71] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:04 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1291 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:04.794524 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-fba0dfd9-2ce4-4f78-bf8c-5a8bbc5a641c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:04.796417 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-fba0dfd9-2ce4-4f78-bf8c-5a8bbc5a641c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:04.821229 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fba0dfd9-2ce4-4f78-bf8c-5a8bbc5a641c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:04.823933 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fba0dfd9-2ce4-4f78-bf8c-5a8bbc5a641c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:04.825888 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fba0dfd9-2ce4-4f78-bf8c-5a8bbc5a641c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:04.827277 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fba0dfd9-2ce4-4f78-bf8c-5a8bbc5a641c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:05.020497 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-fba0dfd9-2ce4-4f78-bf8c-5a8bbc5a641c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:05.045744 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-fba0dfd9-2ce4-4f78-bf8c-5a8bbc5a641c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:05.048662 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-fba0dfd9-2ce4-4f78-bf8c-5a8bbc5a641c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:05.059120 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-fba0dfd9-2ce4-4f78-bf8c-5a8bbc5a641c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1339 microversion: 2.20 time: 0.287210 May 26 12:33:05.059979 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 36/72] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:04 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1339 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:05.080893 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-5f8e53d7-2936-4315-ad7b-855cae37ee02 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:05.082339 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-5f8e53d7-2936-4315-ad7b-855cae37ee02 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:05.111872 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5f8e53d7-2936-4315-ad7b-855cae37ee02 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:05.112972 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5f8e53d7-2936-4315-ad7b-855cae37ee02 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:05.115432 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5f8e53d7-2936-4315-ad7b-855cae37ee02 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:05.116314 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5f8e53d7-2936-4315-ad7b-855cae37ee02 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:05.701063 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-2cd77228-b89c-4034-9d89-27829b189276 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:05.705121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=100 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:05.714192 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-2cd77228-b89c-4034-9d89-27829b189276 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 1.077319 May 26 12:33:05.715502 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 37/73] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:04 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:05.739496 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-5f8e53d7-2936-4315-ad7b-855cae37ee02 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:05.756846 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-5f8e53d7-2936-4315-ad7b-855cae37ee02 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1298 microversion: 2.1 time: 0.693112 May 26 12:33:05.757711 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 37/74] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:05 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1298 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:05.777914 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-62d4f196-ab91-4ce7-a793-89def4fa9b0e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:05.778539 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-62d4f196-ab91-4ce7-a793-89def4fa9b0e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:05.796153 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-62d4f196-ab91-4ce7-a793-89def4fa9b0e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:05.796626 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-62d4f196-ab91-4ce7-a793-89def4fa9b0e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:05.801810 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-62d4f196-ab91-4ce7-a793-89def4fa9b0e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:05.804055 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-62d4f196-ab91-4ce7-a793-89def4fa9b0e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:06.035276 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-62d4f196-ab91-4ce7-a793-89def4fa9b0e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:06.050392 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-62d4f196-ab91-4ce7-a793-89def4fa9b0e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1279 microversion: 2.1 time: 0.277477 May 26 12:33:06.052811 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 38/75] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:05 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1279 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:06.104193 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-7cd1174d-f10f-4ff2-8bbd-47b38f4cc5e8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:06.105956 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-7cd1174d-f10f-4ff2-8bbd-47b38f4cc5e8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:06.116392 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7cd1174d-f10f-4ff2-8bbd-47b38f4cc5e8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:06.117379 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7cd1174d-f10f-4ff2-8bbd-47b38f4cc5e8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:06.118432 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7cd1174d-f10f-4ff2-8bbd-47b38f4cc5e8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:06.119107 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7cd1174d-f10f-4ff2-8bbd-47b38f4cc5e8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:06.297365 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-7cd1174d-f10f-4ff2-8bbd-47b38f4cc5e8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:06.308540 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-7cd1174d-f10f-4ff2-8bbd-47b38f4cc5e8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:06.318080 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-7cd1174d-f10f-4ff2-8bbd-47b38f4cc5e8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:06.325669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-7cd1174d-f10f-4ff2-8bbd-47b38f4cc5e8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1339 microversion: 2.20 time: 0.225651 May 26 12:33:06.327853 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 38/76] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:06 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1339 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:06.732042 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-693cca7f-b6ed-43aa-b0d8-eb2a7aadf545 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:06.732756 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-693cca7f-b6ed-43aa-b0d8-eb2a7aadf545 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:06.741364 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-693cca7f-b6ed-43aa-b0d8-eb2a7aadf545 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:06.742110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-693cca7f-b6ed-43aa-b0d8-eb2a7aadf545 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:06.743223 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-693cca7f-b6ed-43aa-b0d8-eb2a7aadf545 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:06.743967 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-693cca7f-b6ed-43aa-b0d8-eb2a7aadf545 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:06.776133 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-207c75af-50a0-4840-93cb-797700fd71e8 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:06.776930 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-207c75af-50a0-4840-93cb-797700fd71e8 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:06.796484 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-207c75af-50a0-4840-93cb-797700fd71e8 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:06.798100 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-207c75af-50a0-4840-93cb-797700fd71e8 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:06.802363 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-207c75af-50a0-4840-93cb-797700fd71e8 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:06.803246 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-207c75af-50a0-4840-93cb-797700fd71e8 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:07.428916 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-693cca7f-b6ed-43aa-b0d8-eb2a7aadf545 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:07.438870 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-693cca7f-b6ed-43aa-b0d8-eb2a7aadf545 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.711217 May 26 12:33:07.445106 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 39/77] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:06 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:07.462627 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-b46a4fdb-c4fe-4d3f-bc3f-85c55995d40b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:07.463452 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-b46a4fdb-c4fe-4d3f-bc3f-85c55995d40b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:07.485959 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b46a4fdb-c4fe-4d3f-bc3f-85c55995d40b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:07.488298 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b46a4fdb-c4fe-4d3f-bc3f-85c55995d40b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:07.489310 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b46a4fdb-c4fe-4d3f-bc3f-85c55995d40b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:07.489765 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b46a4fdb-c4fe-4d3f-bc3f-85c55995d40b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:07.582029 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-207c75af-50a0-4840-93cb-797700fd71e8 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:07.598220 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-207c75af-50a0-4840-93cb-797700fd71e8 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.826267 May 26 12:33:07.598746 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 39/78] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:06 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:07.625377 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-db4e0491-8814-4c62-b715-1817c2f86b64 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:07.632597 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-db4e0491-8814-4c62-b715-1817c2f86b64 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:07.649154 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-db4e0491-8814-4c62-b715-1817c2f86b64 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:07.649613 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-db4e0491-8814-4c62-b715-1817c2f86b64 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:07.650419 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-db4e0491-8814-4c62-b715-1817c2f86b64 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:07.650905 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-db4e0491-8814-4c62-b715-1817c2f86b64 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:08.068238 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-b46a4fdb-c4fe-4d3f-bc3f-85c55995d40b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:08.078969 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-b46a4fdb-c4fe-4d3f-bc3f-85c55995d40b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1279 microversion: 2.1 time: 0.632673 May 26 12:33:08.079754 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 40/79] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:07 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1279 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:08.087750 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-215dc188-49ad-4c38-828f-1a39787c4ab6 req-d8ee584f-d569-467d-96e2-e57d1b915193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "131042dc-6807-4136-b6ed-7aead934b6b2", "tag": "bab2b455-3763-41f4-abad-0835ee7f958f"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:33:08.110332 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-215dc188-49ad-4c38-828f-1a39787c4ab6 req-d8ee584f-d569-467d-96e2-e57d1b915193 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:08.111114 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-215dc188-49ad-4c38-828f-1a39787c4ab6 req-d8ee584f-d569-467d-96e2-e57d1b915193 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:08.140416 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-215dc188-49ad-4c38-828f-1a39787c4ab6 req-d8ee584f-d569-467d-96e2-e57d1b915193 service nova] Creating event network-changed:bab2b455-3763-41f4-abad-0835ee7f958f for instance 131042dc-6807-4136-b6ed-7aead934b6b2 on hv-cinder-81514 May 26 12:33:08.141250 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-215dc188-49ad-4c38-828f-1a39787c4ab6 req-d8ee584f-d569-467d-96e2-e57d1b915193 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 12:33:08.142644 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9563891a-0c84-4808-8609-9099d6d53baf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:08.143201 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9563891a-0c84-4808-8609-9099d6d53baf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:08.144202 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9563891a-0c84-4808-8609-9099d6d53baf None None] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:08.144930 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9563891a-0c84-4808-8609-9099d6d53baf None None] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:08.158738 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.compute.rpcapi [None req-9563891a-0c84-4808-8609-9099d6d53baf None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 12:33:08.160435 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9563891a-0c84-4808-8609-9099d6d53baf None None] Releasing lock "compute-rpcapi-router" {{(pid=124133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 12:33:08.185876 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-9563891a-0c84-4808-8609-9099d6d53baf None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104041 May 26 12:33:08.187195 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 41/80] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:33:08.312706 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-accf20f9-ce44-4cc9-bb08-710f92505d7c req-02f42c3f-6018-4ad2-b230-c93b3863b53c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b01a615-8fbe-4303-a8e0-6146799a92a1", "name": "network-vif-plugged", "status": "completed", "tag": "cfb303af-9284-4763-8dc5-4ba92ee9dc4b"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:33:08.326268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-accf20f9-ce44-4cc9-bb08-710f92505d7c req-02f42c3f-6018-4ad2-b230-c93b3863b53c service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:08.327906 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-accf20f9-ce44-4cc9-bb08-710f92505d7c req-02f42c3f-6018-4ad2-b230-c93b3863b53c service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:08.370640 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-accf20f9-ce44-4cc9-bb08-710f92505d7c req-02f42c3f-6018-4ad2-b230-c93b3863b53c service nova] Creating event network-vif-plugged:cfb303af-9284-4763-8dc5-4ba92ee9dc4b for instance 7b01a615-8fbe-4303-a8e0-6146799a92a1 on hv-cinder-81514 May 26 12:33:08.384441 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-accf20f9-ce44-4cc9-bb08-710f92505d7c req-02f42c3f-6018-4ad2-b230-c93b3863b53c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194764 May 26 12:33:08.385091 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 42/81] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:33:08.459257 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-69daf9f3-073c-4dca-af72-ac9e1dcd1f8e tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:08.460199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-69daf9f3-073c-4dca-af72-ac9e1dcd1f8e tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:08.474445 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-69daf9f3-073c-4dca-af72-ac9e1dcd1f8e tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:08.474904 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-69daf9f3-073c-4dca-af72-ac9e1dcd1f8e tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:08.475729 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-69daf9f3-073c-4dca-af72-ac9e1dcd1f8e tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:08.476202 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-69daf9f3-073c-4dca-af72-ac9e1dcd1f8e tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:08.958000 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-db4e0491-8814-4c62-b715-1817c2f86b64 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:09.000661 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-db4e0491-8814-4c62-b715-1817c2f86b64 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:09.008890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-db4e0491-8814-4c62-b715-1817c2f86b64 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:09.017464 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-db4e0491-8814-4c62-b715-1817c2f86b64 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 1.410820 May 26 12:33:09.021202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 40/82] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:07 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:09.046413 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-85bc7564-090e-4471-b14c-d7d3d5b4d7e8 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:09.046771 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-85bc7564-090e-4471-b14c-d7d3d5b4d7e8 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:09.083237 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-85bc7564-090e-4471-b14c-d7d3d5b4d7e8 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:09.083855 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-85bc7564-090e-4471-b14c-d7d3d5b4d7e8 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:09.084615 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-85bc7564-090e-4471-b14c-d7d3d5b4d7e8 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:09.090367 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-85bc7564-090e-4471-b14c-d7d3d5b4d7e8 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:09.653619 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-69daf9f3-073c-4dca-af72-ac9e1dcd1f8e tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:09.689899 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-69daf9f3-073c-4dca-af72-ac9e1dcd1f8e tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 1.234443 May 26 12:33:09.691052 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 43/83] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:08 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:09.706204 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-b3bc4153-7733-4558-9932-b44c46958dc3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:09.707856 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-b3bc4153-7733-4558-9932-b44c46958dc3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:09.715599 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b3bc4153-7733-4558-9932-b44c46958dc3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:09.716298 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b3bc4153-7733-4558-9932-b44c46958dc3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:09.717445 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b3bc4153-7733-4558-9932-b44c46958dc3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:09.720235 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b3bc4153-7733-4558-9932-b44c46958dc3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:09.783962 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-85bc7564-090e-4471-b14c-d7d3d5b4d7e8 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:09.793724 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-85bc7564-090e-4471-b14c-d7d3d5b4d7e8 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.765240 May 26 12:33:09.794627 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 41/84] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:09 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:09.896503 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-44ff4938-5c17-4de2-ac38-695e131bdf52 req-881bccde-0f08-4723-8271-1283f38d308c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cfc21dd-efee-45cb-9462-cdd0025a5038", "tag": "c4a31d7d-0831-4fea-a609-85371a2084a6"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:33:09.921980 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-44ff4938-5c17-4de2-ac38-695e131bdf52 req-881bccde-0f08-4723-8271-1283f38d308c service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:09.922424 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-44ff4938-5c17-4de2-ac38-695e131bdf52 req-881bccde-0f08-4723-8271-1283f38d308c service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:09.939512 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-44ff4938-5c17-4de2-ac38-695e131bdf52 req-881bccde-0f08-4723-8271-1283f38d308c service nova] Creating event network-changed:c4a31d7d-0831-4fea-a609-85371a2084a6 for instance 1cfc21dd-efee-45cb-9462-cdd0025a5038 on hv-cinder-81514 May 26 12:33:09.947813 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-44ff4938-5c17-4de2-ac38-695e131bdf52 req-881bccde-0f08-4723-8271-1283f38d308c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150258 May 26 12:33:09.948799 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 42/85] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:33:10.046791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-d6eadc4d-2a19-4aeb-b69e-5b20323361e5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:10.047726 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-d6eadc4d-2a19-4aeb-b69e-5b20323361e5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:10.061220 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d6eadc4d-2a19-4aeb-b69e-5b20323361e5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:10.061910 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d6eadc4d-2a19-4aeb-b69e-5b20323361e5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:10.062694 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d6eadc4d-2a19-4aeb-b69e-5b20323361e5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:10.063133 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d6eadc4d-2a19-4aeb-b69e-5b20323361e5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:10.347468 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-b3bc4153-7733-4558-9932-b44c46958dc3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:10.355825 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-b3bc4153-7733-4558-9932-b44c46958dc3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.663525 May 26 12:33:10.357845 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 44/86] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:09 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:10.453052 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d6eadc4d-2a19-4aeb-b69e-5b20323361e5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:10.470174 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d6eadc4d-2a19-4aeb-b69e-5b20323361e5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:10.473911 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d6eadc4d-2a19-4aeb-b69e-5b20323361e5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:10.477651 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-d6eadc4d-2a19-4aeb-b69e-5b20323361e5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.436648 May 26 12:33:10.480232 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 43/87] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:10 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:10.716553 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-27b6a678-3b68-49fe-bdfe-75e5762e3245 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:10.717417 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-27b6a678-3b68-49fe-bdfe-75e5762e3245 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:10.733573 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-27b6a678-3b68-49fe-bdfe-75e5762e3245 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:10.734036 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-27b6a678-3b68-49fe-bdfe-75e5762e3245 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:10.739641 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-27b6a678-3b68-49fe-bdfe-75e5762e3245 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:10.740337 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-27b6a678-3b68-49fe-bdfe-75e5762e3245 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:10.814556 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-1b7ec3e1-1024-45ff-b419-d6ba1f238d66 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:10.815191 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-1b7ec3e1-1024-45ff-b419-d6ba1f238d66 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:10.822246 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1b7ec3e1-1024-45ff-b419-d6ba1f238d66 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:10.823124 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1b7ec3e1-1024-45ff-b419-d6ba1f238d66 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:10.825033 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1b7ec3e1-1024-45ff-b419-d6ba1f238d66 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:10.825484 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1b7ec3e1-1024-45ff-b419-d6ba1f238d66 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:11.189488 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-27b6a678-3b68-49fe-bdfe-75e5762e3245 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:11.197004 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-27b6a678-3b68-49fe-bdfe-75e5762e3245 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.485779 May 26 12:33:11.205729 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-1b7ec3e1-1024-45ff-b419-d6ba1f238d66 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:11.207317 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 45/88] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:10 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:11.212238 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-e565a2b8-6e15-4486-9889-a6a73b1c35f2 req-28d84051-9bf9-4e5d-a28e-c793e1cc5029 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff659e6a-5e2b-45d6-84d5-360c22ccc03e", "tag": "ce7102b2-644a-427b-bd62-1d31c3727bcb"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:33:11.221437 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-1b7ec3e1-1024-45ff-b419-d6ba1f238d66 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.414239 May 26 12:33:11.222239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 44/89] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:10 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:11.223550 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-e565a2b8-6e15-4486-9889-a6a73b1c35f2 req-28d84051-9bf9-4e5d-a28e-c793e1cc5029 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:11.224219 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-e565a2b8-6e15-4486-9889-a6a73b1c35f2 req-28d84051-9bf9-4e5d-a28e-c793e1cc5029 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:11.242778 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-e565a2b8-6e15-4486-9889-a6a73b1c35f2 req-28d84051-9bf9-4e5d-a28e-c793e1cc5029 service nova] Creating event network-changed:ce7102b2-644a-427b-bd62-1d31c3727bcb for instance ff659e6a-5e2b-45d6-84d5-360c22ccc03e on hv-cinder-81514 May 26 12:33:11.263964 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-e565a2b8-6e15-4486-9889-a6a73b1c35f2 req-28d84051-9bf9-4e5d-a28e-c793e1cc5029 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054900 May 26 12:33:11.264564 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 46/90] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:33:11.374652 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b55eb50f-2e1c-4680-b292-9b0d236aa35d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:11.375263 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b55eb50f-2e1c-4680-b292-9b0d236aa35d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:11.383691 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b55eb50f-2e1c-4680-b292-9b0d236aa35d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:11.386421 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b55eb50f-2e1c-4680-b292-9b0d236aa35d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:11.387394 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b55eb50f-2e1c-4680-b292-9b0d236aa35d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:11.387829 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b55eb50f-2e1c-4680-b292-9b0d236aa35d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:11.501769 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f35bfb9d-0646-4789-97fa-b4ae6f0b8f05 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:11.503407 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f35bfb9d-0646-4789-97fa-b4ae6f0b8f05 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:11.522083 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f35bfb9d-0646-4789-97fa-b4ae6f0b8f05 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:11.522295 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f35bfb9d-0646-4789-97fa-b4ae6f0b8f05 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:11.523412 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f35bfb9d-0646-4789-97fa-b4ae6f0b8f05 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:11.524104 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f35bfb9d-0646-4789-97fa-b4ae6f0b8f05 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:11.615974 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b55eb50f-2e1c-4680-b292-9b0d236aa35d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:11.626841 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b55eb50f-2e1c-4680-b292-9b0d236aa35d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.256524 May 26 12:33:11.628113 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 45/91] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:11 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:11.700348 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f35bfb9d-0646-4789-97fa-b4ae6f0b8f05 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:11.709497 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f35bfb9d-0646-4789-97fa-b4ae6f0b8f05 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:11.711574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f35bfb9d-0646-4789-97fa-b4ae6f0b8f05 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:11.713007 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f35bfb9d-0646-4789-97fa-b4ae6f0b8f05 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.216654 May 26 12:33:11.714653 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 47/92] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:11 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:11.977487 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-e09d2260-dbfd-44e1-b5c3-a7ba06315548 req-39bea943-712e-439b-8e70-74c2d30fb656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7af16d0b-59c7-43ea-856c-ec79029b680c", "tag": "b1b5ee45-e743-4819-bc49-534e21eec9a7"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:33:12.004629 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-e09d2260-dbfd-44e1-b5c3-a7ba06315548 req-39bea943-712e-439b-8e70-74c2d30fb656 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:12.005199 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-e09d2260-dbfd-44e1-b5c3-a7ba06315548 req-39bea943-712e-439b-8e70-74c2d30fb656 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:12.033026 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-e09d2260-dbfd-44e1-b5c3-a7ba06315548 req-39bea943-712e-439b-8e70-74c2d30fb656 service nova] Creating event network-changed:b1b5ee45-e743-4819-bc49-534e21eec9a7 for instance 7af16d0b-59c7-43ea-856c-ec79029b680c on hv-cinder-81514 May 26 12:33:12.038257 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-e09d2260-dbfd-44e1-b5c3-a7ba06315548 req-39bea943-712e-439b-8e70-74c2d30fb656 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065838 May 26 12:33:12.038855 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 46/93] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:33:12.216249 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-603f36e7-ee99-43de-8185-8b8782cddd88 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:12.217673 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-603f36e7-ee99-43de-8185-8b8782cddd88 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:12.224767 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-603f36e7-ee99-43de-8185-8b8782cddd88 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:12.225262 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-603f36e7-ee99-43de-8185-8b8782cddd88 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:12.226265 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-603f36e7-ee99-43de-8185-8b8782cddd88 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:12.226845 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-603f36e7-ee99-43de-8185-8b8782cddd88 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:12.242907 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-bf057e79-10e7-4776-a4da-535a25175839 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:12.243671 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-bf057e79-10e7-4776-a4da-535a25175839 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:12.250949 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bf057e79-10e7-4776-a4da-535a25175839 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:12.251456 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bf057e79-10e7-4776-a4da-535a25175839 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:12.252232 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bf057e79-10e7-4776-a4da-535a25175839 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:12.252663 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bf057e79-10e7-4776-a4da-535a25175839 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:12.533968 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-603f36e7-ee99-43de-8185-8b8782cddd88 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:12.547029 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-603f36e7-ee99-43de-8185-8b8782cddd88 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.336037 May 26 12:33:12.548532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 48/94] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:12 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:12.553876 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-bf057e79-10e7-4776-a4da-535a25175839 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:12.574765 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-bf057e79-10e7-4776-a4da-535a25175839 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.335696 May 26 12:33:12.575767 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 47/95] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:12 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:12.645820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-0a91ef53-793f-44e2-ad89-4c0a5b7b3b44 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:12.646427 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-0a91ef53-793f-44e2-ad89-4c0a5b7b3b44 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:12.657335 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0a91ef53-793f-44e2-ad89-4c0a5b7b3b44 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:12.657335 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0a91ef53-793f-44e2-ad89-4c0a5b7b3b44 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:12.657335 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0a91ef53-793f-44e2-ad89-4c0a5b7b3b44 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:12.657335 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0a91ef53-793f-44e2-ad89-4c0a5b7b3b44 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:12.732333 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b903fb49-937c-4490-969a-3abe6b1011fe tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:12.739769 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b903fb49-937c-4490-969a-3abe6b1011fe tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:12.751169 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b903fb49-937c-4490-969a-3abe6b1011fe tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:12.752068 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b903fb49-937c-4490-969a-3abe6b1011fe tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:12.753226 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b903fb49-937c-4490-969a-3abe6b1011fe tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:12.753759 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b903fb49-937c-4490-969a-3abe6b1011fe tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:13.132740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-0a91ef53-793f-44e2-ad89-4c0a5b7b3b44 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:13.153412 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-0a91ef53-793f-44e2-ad89-4c0a5b7b3b44 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.510650 May 26 12:33:13.154134 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 49/96] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:12 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:13.160014 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-291c0874-18cc-4bec-b219-94c940c96c2b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-961127822", "imageRef": "7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4", "flavorRef": "452", "networks": [{"uuid": "4723ee3b-d43b-4526-a69d-d7330ca62f75"}]}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:33:13.175530 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b903fb49-937c-4490-969a-3abe6b1011fe tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:13.192483 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b903fb49-937c-4490-969a-3abe6b1011fe tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:13.201312 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b903fb49-937c-4490-969a-3abe6b1011fe tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:13.202929 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b903fb49-937c-4490-969a-3abe6b1011fe tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.475410 May 26 12:33:13.216411 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 48/97] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:12 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:33:13.239233 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.network.neutron [None req-291c0874-18cc-4bec-b219-94c940c96c2b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] validate_networks() for [('4723ee3b-d43b-4526-a69d-d7330ca62f75', None, None, None, None, None)] {{(pid=124133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:33:13.575905 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-1b1912bc-d9f9-4802-86ce-0a2422b210e0 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:13.577598 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-1b1912bc-d9f9-4802-86ce-0a2422b210e0 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:13.590686 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1b1912bc-d9f9-4802-86ce-0a2422b210e0 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:13.591220 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1b1912bc-d9f9-4802-86ce-0a2422b210e0 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:13.593503 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1b1912bc-d9f9-4802-86ce-0a2422b210e0 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:13.594284 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1b1912bc-d9f9-4802-86ce-0a2422b210e0 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:13.966088 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-1b1912bc-d9f9-4802-86ce-0a2422b210e0 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:13.977804 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-1b1912bc-d9f9-4802-86ce-0a2422b210e0 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.409385 May 26 12:33:13.978912 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 49/98] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:13 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:13.987247 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-32947454-863e-4542-b695-3be4f104eb04 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:13.988481 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-32947454-863e-4542-b695-3be4f104eb04 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:13.996762 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-32947454-863e-4542-b695-3be4f104eb04 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:13.998318 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-32947454-863e-4542-b695-3be4f104eb04 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:13.999334 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-32947454-863e-4542-b695-3be4f104eb04 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:14.000375 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-32947454-863e-4542-b695-3be4f104eb04 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:14.278309 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-291c0874-18cc-4bec-b219-94c940c96c2b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Flavor limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:33:14.279259 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-291c0874-18cc-4bec-b219-94c940c96c2b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Image limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:33:14.280011 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-291c0874-18cc-4bec-b219-94c940c96c2b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Flavor pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:33:14.281565 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-291c0874-18cc-4bec-b219-94c940c96c2b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Image pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:33:14.282752 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-291c0874-18cc-4bec-b219-94c940c96c2b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:33:14.298013 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-291c0874-18cc-4bec-b219-94c940c96c2b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:14.299346 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-291c0874-18cc-4bec-b219-94c940c96c2b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:14.300313 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-291c0874-18cc-4bec-b219-94c940c96c2b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:14.301763 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-291c0874-18cc-4bec-b219-94c940c96c2b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:14.322401 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-291c0874-18cc-4bec-b219-94c940c96c2b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Getting quotas for project 1262e1a887bf44b0ae7fa8ac522e1250. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:33:14.326750 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-291c0874-18cc-4bec-b219-94c940c96c2b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Getting quotas for user c30a4258c6024a7c9ef1fbd694fa9bfd and project 1262e1a887bf44b0ae7fa8ac522e1250. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:33:14.338198 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-291c0874-18cc-4bec-b219-94c940c96c2b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Going to run 1 instances... {{(pid=124133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:33:14.348748 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-291c0874-18cc-4bec-b219-94c940c96c2b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:33:14.350544 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-32947454-863e-4542-b695-3be4f104eb04 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:14.352857 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=100 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:14.360071 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-32947454-863e-4542-b695-3be4f104eb04 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.379120 May 26 12:33:14.360649 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 50/99] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:13 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:14.365521 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-5478f860-9337-4e69-b05d-6bfb5aea37bb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:14.366137 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-5478f860-9337-4e69-b05d-6bfb5aea37bb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:14.373275 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5478f860-9337-4e69-b05d-6bfb5aea37bb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:14.373734 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5478f860-9337-4e69-b05d-6bfb5aea37bb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:14.374512 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5478f860-9337-4e69-b05d-6bfb5aea37bb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:14.374990 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5478f860-9337-4e69-b05d-6bfb5aea37bb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:14.413826 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-291c0874-18cc-4bec-b219-94c940c96c2b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.257686 May 26 12:33:14.414998 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 50/100] 10.222.0.39 () {60 vars in 1146 bytes} [Thu May 26 12:33:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:33:14.420128 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-58ff046a-379c-4f36-8c9a-f6eb20651fd2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:14.420946 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-58ff046a-379c-4f36-8c9a-f6eb20651fd2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:14.429628 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-58ff046a-379c-4f36-8c9a-f6eb20651fd2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:14.430331 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-58ff046a-379c-4f36-8c9a-f6eb20651fd2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:14.431250 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-58ff046a-379c-4f36-8c9a-f6eb20651fd2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:14.431835 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-58ff046a-379c-4f36-8c9a-f6eb20651fd2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:14.591851 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-5478f860-9337-4e69-b05d-6bfb5aea37bb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:14.613443 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-5478f860-9337-4e69-b05d-6bfb5aea37bb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.251625 May 26 12:33:14.615707 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 51/101] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:14 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:14.622190 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-a119f058-8469-4188-8195-189d03eaf441 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:14.623484 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-a119f058-8469-4188-8195-189d03eaf441 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:14.674144 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-58ff046a-379c-4f36-8c9a-f6eb20651fd2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:14.686003 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-58ff046a-379c-4f36-8c9a-f6eb20651fd2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:14.688090 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-58ff046a-379c-4f36-8c9a-f6eb20651fd2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:14.690014 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-58ff046a-379c-4f36-8c9a-f6eb20651fd2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.273841 May 26 12:33:14.692927 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 51/102] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:14 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:14.701633 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a119f058-8469-4188-8195-189d03eaf441 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:14.709223 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-a119f058-8469-4188-8195-189d03eaf441 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1213 microversion: 2.1 time: 0.092018 May 26 12:33:14.710287 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 52/103] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:14 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:14.999182 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-9c3e195d-f72d-4c7d-b7f6-d426a0c9b9f4 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:14.999931 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-9c3e195d-f72d-4c7d-b7f6-d426a0c9b9f4 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:15.012302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9c3e195d-f72d-4c7d-b7f6-d426a0c9b9f4 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:15.013277 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9c3e195d-f72d-4c7d-b7f6-d426a0c9b9f4 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:15.014386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9c3e195d-f72d-4c7d-b7f6-d426a0c9b9f4 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:15.014896 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9c3e195d-f72d-4c7d-b7f6-d426a0c9b9f4 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:15.207000 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-9c3e195d-f72d-4c7d-b7f6-d426a0c9b9f4 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:15.218515 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-9c3e195d-f72d-4c7d-b7f6-d426a0c9b9f4 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.224916 May 26 12:33:15.219405 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 52/104] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:14 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:15.381949 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-19ddaa80-39dc-49eb-93b1-52f24bebf214 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:15.401963 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-19ddaa80-39dc-49eb-93b1-52f24bebf214 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:15.413320 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-19ddaa80-39dc-49eb-93b1-52f24bebf214 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:15.414285 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-19ddaa80-39dc-49eb-93b1-52f24bebf214 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:15.417348 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-19ddaa80-39dc-49eb-93b1-52f24bebf214 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:15.418660 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-19ddaa80-39dc-49eb-93b1-52f24bebf214 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:15.640311 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-12865bf7-6c5e-4e5b-9a43-bac786c9ff46 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:15.641681 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-12865bf7-6c5e-4e5b-9a43-bac786c9ff46 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:15.657153 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-12865bf7-6c5e-4e5b-9a43-bac786c9ff46 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:15.658465 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-12865bf7-6c5e-4e5b-9a43-bac786c9ff46 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:15.660034 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-12865bf7-6c5e-4e5b-9a43-bac786c9ff46 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:15.661241 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-12865bf7-6c5e-4e5b-9a43-bac786c9ff46 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:15.689808 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-19ddaa80-39dc-49eb-93b1-52f24bebf214 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:15.708479 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-19ddaa80-39dc-49eb-93b1-52f24bebf214 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.332391 May 26 12:33:15.724832 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 53/105] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:15 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:15.737672 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-2afa80e6-fe88-4d13-ada1-c1531ee35b93 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:15.738532 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-2afa80e6-fe88-4d13-ada1-c1531ee35b93 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:15.753879 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2afa80e6-fe88-4d13-ada1-c1531ee35b93 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:15.755399 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2afa80e6-fe88-4d13-ada1-c1531ee35b93 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:15.757406 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2afa80e6-fe88-4d13-ada1-c1531ee35b93 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:15.759303 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2afa80e6-fe88-4d13-ada1-c1531ee35b93 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:16.056546 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-12865bf7-6c5e-4e5b-9a43-bac786c9ff46 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:16.075209 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2afa80e6-fe88-4d13-ada1-c1531ee35b93 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:16.080657 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-12865bf7-6c5e-4e5b-9a43-bac786c9ff46 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.444756 May 26 12:33:16.083090 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 53/106] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:15 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:16.098483 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2afa80e6-fe88-4d13-ada1-c1531ee35b93 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:16.099402 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-717fc237-9ecb-4aea-a003-c511080ff458 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:16.100458 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2afa80e6-fe88-4d13-ada1-c1531ee35b93 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:16.101469 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-717fc237-9ecb-4aea-a003-c511080ff458 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:16.102057 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-2afa80e6-fe88-4d13-ada1-c1531ee35b93 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.375371 May 26 12:33:16.102753 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 54/107] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:15 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:16.123664 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-717fc237-9ecb-4aea-a003-c511080ff458 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:16.124396 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-717fc237-9ecb-4aea-a003-c511080ff458 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:16.125867 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-717fc237-9ecb-4aea-a003-c511080ff458 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:16.126888 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-717fc237-9ecb-4aea-a003-c511080ff458 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:16.170623 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-8ce6ba09-9eb3-4643-a444-6a4e06543b69 req-e9110b7e-df67-4b0e-ad7c-aade27e5dcc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131042dc-6807-4136-b6ed-7aead934b6b2", "name": "network-vif-plugged", "status": "completed", "tag": "bab2b455-3763-41f4-abad-0835ee7f958f"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:33:16.192376 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-8ce6ba09-9eb3-4643-a444-6a4e06543b69 req-e9110b7e-df67-4b0e-ad7c-aade27e5dcc1 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:16.193373 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-8ce6ba09-9eb3-4643-a444-6a4e06543b69 req-e9110b7e-df67-4b0e-ad7c-aade27e5dcc1 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:16.215279 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-8ce6ba09-9eb3-4643-a444-6a4e06543b69 req-e9110b7e-df67-4b0e-ad7c-aade27e5dcc1 service nova] Creating event network-vif-plugged:bab2b455-3763-41f4-abad-0835ee7f958f for instance 131042dc-6807-4136-b6ed-7aead934b6b2 on hv-cinder-81514 May 26 12:33:16.222569 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-8ce6ba09-9eb3-4643-a444-6a4e06543b69 req-e9110b7e-df67-4b0e-ad7c-aade27e5dcc1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068299 May 26 12:33:16.224241 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 55/108] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:33:16.228605 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-717fc237-9ecb-4aea-a003-c511080ff458 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:16.243472 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-8a30b040-c78f-4f0a-842c-adb533951c3f tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:16.244185 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-8a30b040-c78f-4f0a-842c-adb533951c3f tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:16.248940 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-717fc237-9ecb-4aea-a003-c511080ff458 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1217 microversion: 2.1 time: 0.160969 May 26 12:33:16.249857 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 54/109] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:16 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1217 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:16.251607 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8a30b040-c78f-4f0a-842c-adb533951c3f tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:16.252111 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8a30b040-c78f-4f0a-842c-adb533951c3f tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:16.252945 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8a30b040-c78f-4f0a-842c-adb533951c3f tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:16.253614 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8a30b040-c78f-4f0a-842c-adb533951c3f tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:16.415965 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-8a30b040-c78f-4f0a-842c-adb533951c3f tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:16.423781 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-8a30b040-c78f-4f0a-842c-adb533951c3f tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.184785 May 26 12:33:16.424517 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 56/110] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:16 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:16.744014 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-adb42c8e-dc7e-4e07-88c3-4dedcdd902fe tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:16.758902 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-adb42c8e-dc7e-4e07-88c3-4dedcdd902fe tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:16.772164 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-adb42c8e-dc7e-4e07-88c3-4dedcdd902fe tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:16.772622 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-adb42c8e-dc7e-4e07-88c3-4dedcdd902fe tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:16.773428 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-adb42c8e-dc7e-4e07-88c3-4dedcdd902fe tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:16.773864 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-adb42c8e-dc7e-4e07-88c3-4dedcdd902fe tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:16.941480 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-adb42c8e-dc7e-4e07-88c3-4dedcdd902fe tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:16.949563 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-adb42c8e-dc7e-4e07-88c3-4dedcdd902fe tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.215100 May 26 12:33:16.950134 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 55/111] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:16 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:17.101992 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e1d495de-7470-4b45-aad0-a46c5dc75440 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:17.102605 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-e1d495de-7470-4b45-aad0-a46c5dc75440 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:17.110286 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e1d495de-7470-4b45-aad0-a46c5dc75440 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:17.110811 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e1d495de-7470-4b45-aad0-a46c5dc75440 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:17.111574 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e1d495de-7470-4b45-aad0-a46c5dc75440 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:17.112189 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e1d495de-7470-4b45-aad0-a46c5dc75440 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:17.123978 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-11618602-cc36-44cc-a988-caac41d84537 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:17.124588 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-11618602-cc36-44cc-a988-caac41d84537 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:17.132300 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-11618602-cc36-44cc-a988-caac41d84537 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:17.133308 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-11618602-cc36-44cc-a988-caac41d84537 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:17.134147 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-11618602-cc36-44cc-a988-caac41d84537 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:17.134590 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-11618602-cc36-44cc-a988-caac41d84537 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:17.308400 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-e1d495de-7470-4b45-aad0-a46c5dc75440 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:17.317498 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-e1d495de-7470-4b45-aad0-a46c5dc75440 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.219529 May 26 12:33:17.318202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 57/112] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:17 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:17.331769 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-11618602-cc36-44cc-a988-caac41d84537 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:17.332393 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-46823638-5da4-46ad-a906-f49b875c6f9f tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:17.333106 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-46823638-5da4-46ad-a906-f49b875c6f9f tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:17.334181 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=100 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:17.340933 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-46823638-5da4-46ad-a906-f49b875c6f9f tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:17.341470 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-46823638-5da4-46ad-a906-f49b875c6f9f tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:17.342311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-46823638-5da4-46ad-a906-f49b875c6f9f tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:17.342820 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-46823638-5da4-46ad-a906-f49b875c6f9f tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:17.342912 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-11618602-cc36-44cc-a988-caac41d84537 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:17.344649 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-11618602-cc36-44cc-a988-caac41d84537 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:17.345783 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-11618602-cc36-44cc-a988-caac41d84537 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.226439 May 26 12:33:17.346494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 56/113] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:17 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:17.413035 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-46823638-5da4-46ad-a906-f49b875c6f9f tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:17.420513 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-46823638-5da4-46ad-a906-f49b875c6f9f tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1217 microversion: 2.1 time: 0.091995 May 26 12:33:17.421112 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 58/114] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:17 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:17.441281 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-86700edd-f79c-4f4c-a732-cca8b1b8cd83 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:17.442158 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-86700edd-f79c-4f4c-a732-cca8b1b8cd83 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:17.448796 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-86700edd-f79c-4f4c-a732-cca8b1b8cd83 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:17.449249 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-86700edd-f79c-4f4c-a732-cca8b1b8cd83 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:17.452744 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-86700edd-f79c-4f4c-a732-cca8b1b8cd83 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:17.452744 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-86700edd-f79c-4f4c-a732-cca8b1b8cd83 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:17.597038 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-86700edd-f79c-4f4c-a732-cca8b1b8cd83 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:17.607491 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-86700edd-f79c-4f4c-a732-cca8b1b8cd83 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.170000 May 26 12:33:17.608159 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 57/115] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:17 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:17.972358 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-eec68f7c-5a25-4e1a-9811-1c7a05baba0f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:17.973861 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-eec68f7c-5a25-4e1a-9811-1c7a05baba0f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:17.986441 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-eec68f7c-5a25-4e1a-9811-1c7a05baba0f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:17.987683 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-eec68f7c-5a25-4e1a-9811-1c7a05baba0f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:17.988734 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-eec68f7c-5a25-4e1a-9811-1c7a05baba0f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:18.002776 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-eec68f7c-5a25-4e1a-9811-1c7a05baba0f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:18.152547 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-eec68f7c-5a25-4e1a-9811-1c7a05baba0f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:18.160321 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-eec68f7c-5a25-4e1a-9811-1c7a05baba0f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.196491 May 26 12:33:18.169729 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 59/116] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:17 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:18.335417 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-c4bc3516-4d29-4fae-8664-2866647c7667 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:18.336032 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-c4bc3516-4d29-4fae-8664-2866647c7667 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:18.342283 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c4bc3516-4d29-4fae-8664-2866647c7667 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:18.342854 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c4bc3516-4d29-4fae-8664-2866647c7667 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:18.343649 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c4bc3516-4d29-4fae-8664-2866647c7667 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:18.344097 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c4bc3516-4d29-4fae-8664-2866647c7667 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:18.368661 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b4207c64-5861-4a1c-8bf3-f647ba5726f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:18.369305 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b4207c64-5861-4a1c-8bf3-f647ba5726f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:18.375982 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b4207c64-5861-4a1c-8bf3-f647ba5726f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:18.376432 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b4207c64-5861-4a1c-8bf3-f647ba5726f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:18.377229 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b4207c64-5861-4a1c-8bf3-f647ba5726f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:18.377669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b4207c64-5861-4a1c-8bf3-f647ba5726f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:18.522478 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-c4bc3516-4d29-4fae-8664-2866647c7667 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:18.530734 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-c4bc3516-4d29-4fae-8664-2866647c7667 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.199087 May 26 12:33:18.531211 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 58/117] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:18 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:18.535877 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-5f352a7f-20ad-4f12-bdd7-f9aae72547ed tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:18.536730 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-5f352a7f-20ad-4f12-bdd7-f9aae72547ed tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:18.543412 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5f352a7f-20ad-4f12-bdd7-f9aae72547ed tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:18.543888 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5f352a7f-20ad-4f12-bdd7-f9aae72547ed tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:18.545229 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5f352a7f-20ad-4f12-bdd7-f9aae72547ed tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:18.545229 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5f352a7f-20ad-4f12-bdd7-f9aae72547ed tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:18.555357 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b4207c64-5861-4a1c-8bf3-f647ba5726f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:18.564818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b4207c64-5861-4a1c-8bf3-f647ba5726f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:18.566356 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b4207c64-5861-4a1c-8bf3-f647ba5726f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:18.567446 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b4207c64-5861-4a1c-8bf3-f647ba5726f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.202690 May 26 12:33:18.567995 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 60/118] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:18 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:33:18.618961 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-5f352a7f-20ad-4f12-bdd7-f9aae72547ed tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:18.626774 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-0abcdff8-409a-4267-a7f9-35e57a17ed19 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:18.627327 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-5f352a7f-20ad-4f12-bdd7-f9aae72547ed tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1217 microversion: 2.1 time: 0.095112 May 26 12:33:18.627591 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-0abcdff8-409a-4267-a7f9-35e57a17ed19 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:18.627902 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 59/119] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:18 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:18.633752 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0abcdff8-409a-4267-a7f9-35e57a17ed19 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:18.634265 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0abcdff8-409a-4267-a7f9-35e57a17ed19 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:18.635090 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0abcdff8-409a-4267-a7f9-35e57a17ed19 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:18.635617 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0abcdff8-409a-4267-a7f9-35e57a17ed19 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:18.765090 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-0abcdff8-409a-4267-a7f9-35e57a17ed19 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:18.772487 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-0abcdff8-409a-4267-a7f9-35e57a17ed19 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.149645 May 26 12:33:18.773077 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 61/120] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:18 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:19.177360 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-291bc11c-116f-438c-90ef-faf236fea6d2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:19.177970 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-291bc11c-116f-438c-90ef-faf236fea6d2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:19.184050 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-291bc11c-116f-438c-90ef-faf236fea6d2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:19.184505 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-291bc11c-116f-438c-90ef-faf236fea6d2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:19.185293 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-291bc11c-116f-438c-90ef-faf236fea6d2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:19.185737 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-291bc11c-116f-438c-90ef-faf236fea6d2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:19.318292 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-291bc11c-116f-438c-90ef-faf236fea6d2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:19.326715 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-291bc11c-116f-438c-90ef-faf236fea6d2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.153218 May 26 12:33:19.327295 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 60/121] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:19 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:19.548504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-cae479ae-f4e9-42a1-9d37-e9e34ff1d5d5 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:19.549039 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-cae479ae-f4e9-42a1-9d37-e9e34ff1d5d5 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:19.555077 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cae479ae-f4e9-42a1-9d37-e9e34ff1d5d5 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:19.555519 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cae479ae-f4e9-42a1-9d37-e9e34ff1d5d5 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:19.556271 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cae479ae-f4e9-42a1-9d37-e9e34ff1d5d5 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:19.556705 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cae479ae-f4e9-42a1-9d37-e9e34ff1d5d5 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:19.585763 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-cc9b070f-370b-4dc4-8885-820151ba0051 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:19.586583 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-cc9b070f-370b-4dc4-8885-820151ba0051 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:19.593657 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cc9b070f-370b-4dc4-8885-820151ba0051 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:19.594175 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cc9b070f-370b-4dc4-8885-820151ba0051 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:19.595014 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cc9b070f-370b-4dc4-8885-820151ba0051 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:19.595512 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cc9b070f-370b-4dc4-8885-820151ba0051 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:19.740134 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-cae479ae-f4e9-42a1-9d37-e9e34ff1d5d5 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:19.751439 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-cae479ae-f4e9-42a1-9d37-e9e34ff1d5d5 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.206411 May 26 12:33:19.753269 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 62/122] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:19 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:19.757310 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-8ae16270-ad88-4f51-852e-28b60baa3546 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:19.758064 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-8ae16270-ad88-4f51-852e-28b60baa3546 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:19.766556 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-cc9b070f-370b-4dc4-8885-820151ba0051 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:19.766808 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8ae16270-ad88-4f51-852e-28b60baa3546 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:19.767660 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8ae16270-ad88-4f51-852e-28b60baa3546 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:19.769137 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8ae16270-ad88-4f51-852e-28b60baa3546 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:19.769926 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8ae16270-ad88-4f51-852e-28b60baa3546 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:19.775843 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-cc9b070f-370b-4dc4-8885-820151ba0051 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:19.778918 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-cc9b070f-370b-4dc4-8885-820151ba0051 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:19.780294 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-cc9b070f-370b-4dc4-8885-820151ba0051 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.198320 May 26 12:33:19.781000 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 61/123] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:19 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:19.790067 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-0e55b796-b350-4cd7-a089-4f30caae39ee tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:19.791322 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-0e55b796-b350-4cd7-a089-4f30caae39ee tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:19.797621 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0e55b796-b350-4cd7-a089-4f30caae39ee tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:19.798077 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0e55b796-b350-4cd7-a089-4f30caae39ee tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:19.798917 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0e55b796-b350-4cd7-a089-4f30caae39ee tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:19.799307 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0e55b796-b350-4cd7-a089-4f30caae39ee tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:19.852319 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-8ae16270-ad88-4f51-852e-28b60baa3546 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:19.859356 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-8ae16270-ad88-4f51-852e-28b60baa3546 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1217 microversion: 2.1 time: 0.105708 May 26 12:33:19.859929 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 63/124] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:19 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:19.941428 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-0e55b796-b350-4cd7-a089-4f30caae39ee tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:19.949482 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-0e55b796-b350-4cd7-a089-4f30caae39ee tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.163249 May 26 12:33:19.950056 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 62/125] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:19 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:20.344112 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-9f8b152d-9629-4be5-876d-e2649f5ffe21 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:20.344627 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-9f8b152d-9629-4be5-876d-e2649f5ffe21 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:20.350806 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9f8b152d-9629-4be5-876d-e2649f5ffe21 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:20.351252 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9f8b152d-9629-4be5-876d-e2649f5ffe21 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:20.352016 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9f8b152d-9629-4be5-876d-e2649f5ffe21 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:20.352440 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9f8b152d-9629-4be5-876d-e2649f5ffe21 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:20.501441 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-9f8b152d-9629-4be5-876d-e2649f5ffe21 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:20.509365 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-9f8b152d-9629-4be5-876d-e2649f5ffe21 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.169375 May 26 12:33:20.509921 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 64/126] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:20 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:20.769853 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-35962679-e889-4cb1-b106-87a2608091db tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:20.770453 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-35962679-e889-4cb1-b106-87a2608091db tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:20.776492 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-35962679-e889-4cb1-b106-87a2608091db tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:20.776964 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-35962679-e889-4cb1-b106-87a2608091db tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:20.777711 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-35962679-e889-4cb1-b106-87a2608091db tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:20.778142 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-35962679-e889-4cb1-b106-87a2608091db tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:20.799113 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-d10b89b8-904d-4e37-bd1c-3fca8a7d2743 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:20.799747 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-d10b89b8-904d-4e37-bd1c-3fca8a7d2743 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:20.801756 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=100 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:20.808643 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d10b89b8-904d-4e37-bd1c-3fca8a7d2743 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:20.808643 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d10b89b8-904d-4e37-bd1c-3fca8a7d2743 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:20.809188 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d10b89b8-904d-4e37-bd1c-3fca8a7d2743 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:20.809623 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d10b89b8-904d-4e37-bd1c-3fca8a7d2743 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:21.000664 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-35962679-e889-4cb1-b106-87a2608091db tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:21.008361 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d10b89b8-904d-4e37-bd1c-3fca8a7d2743 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:21.009537 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-35962679-e889-4cb1-b106-87a2608091db tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.243491 May 26 12:33:21.020535 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 63/127] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:20 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:21.025363 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d10b89b8-904d-4e37-bd1c-3fca8a7d2743 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:21.026529 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-7425c804-7875-4ffd-8abf-1e20d466041e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:21.027440 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-7425c804-7875-4ffd-8abf-1e20d466041e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:21.027697 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d10b89b8-904d-4e37-bd1c-3fca8a7d2743 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:21.029845 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-d10b89b8-904d-4e37-bd1c-3fca8a7d2743 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.234640 May 26 12:33:21.030772 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 65/128] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:20 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:33:21.033183 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:21.034949 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7425c804-7875-4ffd-8abf-1e20d466041e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:21.035477 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7425c804-7875-4ffd-8abf-1e20d466041e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:21.036322 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7425c804-7875-4ffd-8abf-1e20d466041e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:21.036866 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7425c804-7875-4ffd-8abf-1e20d466041e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:21.055671 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-87f76040-4357-4d3e-a641-6f2043a2debb tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:21.056283 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-87f76040-4357-4d3e-a641-6f2043a2debb tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:21.063193 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-87f76040-4357-4d3e-a641-6f2043a2debb tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:21.063920 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-87f76040-4357-4d3e-a641-6f2043a2debb tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:21.064944 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-87f76040-4357-4d3e-a641-6f2043a2debb tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:21.065611 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-87f76040-4357-4d3e-a641-6f2043a2debb tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:21.398786 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-7425c804-7875-4ffd-8abf-1e20d466041e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:21.407268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-7425c804-7875-4ffd-8abf-1e20d466041e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1217 microversion: 2.1 time: 0.385794 May 26 12:33:21.407844 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 64/129] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:21 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1217 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:21.527087 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-76553701-b782-4f71-b4d7-76042b69d950 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:21.527931 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-76553701-b782-4f71-b4d7-76042b69d950 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:21.534798 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-76553701-b782-4f71-b4d7-76042b69d950 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:21.535485 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-76553701-b782-4f71-b4d7-76042b69d950 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:21.536281 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-76553701-b782-4f71-b4d7-76042b69d950 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:21.536768 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-76553701-b782-4f71-b4d7-76042b69d950 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:21.563148 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-87f76040-4357-4d3e-a641-6f2043a2debb tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:21.570674 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-87f76040-4357-4d3e-a641-6f2043a2debb tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1314 microversion: 2.1 time: 0.538812 May 26 12:33:21.571235 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 66/130] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:21 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:21.667922 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-76553701-b782-4f71-b4d7-76042b69d950 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:21.675859 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-76553701-b782-4f71-b4d7-76042b69d950 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.153950 May 26 12:33:21.676424 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 65/131] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:21 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:22.027075 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-921d9f42-e107-4cbc-943d-808d1f23035f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:22.027708 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-921d9f42-e107-4cbc-943d-808d1f23035f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:22.033893 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-921d9f42-e107-4cbc-943d-808d1f23035f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:22.034346 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-921d9f42-e107-4cbc-943d-808d1f23035f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:22.035146 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-921d9f42-e107-4cbc-943d-808d1f23035f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:22.035603 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-921d9f42-e107-4cbc-943d-808d1f23035f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:22.047895 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-87461b1c-2450-4033-afd3-40a5c5f1f767 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:22.048527 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-87461b1c-2450-4033-afd3-40a5c5f1f767 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:22.054814 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-87461b1c-2450-4033-afd3-40a5c5f1f767 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:22.055263 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-87461b1c-2450-4033-afd3-40a5c5f1f767 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:22.056035 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-87461b1c-2450-4033-afd3-40a5c5f1f767 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:22.056593 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-87461b1c-2450-4033-afd3-40a5c5f1f767 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:22.250303 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-87461b1c-2450-4033-afd3-40a5c5f1f767 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:22.258637 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-921d9f42-e107-4cbc-943d-808d1f23035f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:22.258845 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-87461b1c-2450-4033-afd3-40a5c5f1f767 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:22.260289 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-87461b1c-2450-4033-afd3-40a5c5f1f767 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:22.261614 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-87461b1c-2450-4033-afd3-40a5c5f1f767 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.217646 May 26 12:33:22.264392 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 66/132] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:22 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:33:22.267439 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-921d9f42-e107-4cbc-943d-808d1f23035f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.244476 May 26 12:33:22.268427 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 67/133] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:22 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:22.423656 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d350f1fd-06d5-46ab-98c6-cf1864e2a74f tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:22.424298 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d350f1fd-06d5-46ab-98c6-cf1864e2a74f tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:22.430191 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d350f1fd-06d5-46ab-98c6-cf1864e2a74f tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:22.430630 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d350f1fd-06d5-46ab-98c6-cf1864e2a74f tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:22.431385 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d350f1fd-06d5-46ab-98c6-cf1864e2a74f tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:22.431818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d350f1fd-06d5-46ab-98c6-cf1864e2a74f tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:22.497311 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d350f1fd-06d5-46ab-98c6-cf1864e2a74f tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:22.504912 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-d350f1fd-06d5-46ab-98c6-cf1864e2a74f tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1217 microversion: 2.1 time: 0.085053 May 26 12:33:22.505571 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 67/134] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:22 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:22.595509 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-15cf8326-2cd4-477f-bfff-cc6bc382528c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:22.595509 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-15cf8326-2cd4-477f-bfff-cc6bc382528c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:22.595699 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-15cf8326-2cd4-477f-bfff-cc6bc382528c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:22.596306 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-15cf8326-2cd4-477f-bfff-cc6bc382528c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:22.597324 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-15cf8326-2cd4-477f-bfff-cc6bc382528c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:22.597842 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-15cf8326-2cd4-477f-bfff-cc6bc382528c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:22.695665 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-3850d8d7-ae39-48a9-b236-5044a049c4c1 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:22.696321 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-3850d8d7-ae39-48a9-b236-5044a049c4c1 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:22.702867 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3850d8d7-ae39-48a9-b236-5044a049c4c1 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:22.703381 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3850d8d7-ae39-48a9-b236-5044a049c4c1 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:22.704163 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3850d8d7-ae39-48a9-b236-5044a049c4c1 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:22.704627 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3850d8d7-ae39-48a9-b236-5044a049c4c1 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:22.762253 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-15cf8326-2cd4-477f-bfff-cc6bc382528c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:22.770400 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-15cf8326-2cd4-477f-bfff-cc6bc382528c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1501 microversion: 2.1 time: 0.186816 May 26 12:33:22.770964 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 68/135] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:22 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1501 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:22.871048 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-3850d8d7-ae39-48a9-b236-5044a049c4c1 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:22.879677 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-3850d8d7-ae39-48a9-b236-5044a049c4c1 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.187675 May 26 12:33:22.890756 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 68/136] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:22 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:23.285094 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-6154f9c2-ffe4-4ca0-8b23-212dfabfeec2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:23.285791 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-6154f9c2-ffe4-4ca0-8b23-212dfabfeec2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:23.286937 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-5701f5e4-b30b-4fb2-bb89-0143b4cd879c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:23.287805 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-5701f5e4-b30b-4fb2-bb89-0143b4cd879c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:23.292239 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6154f9c2-ffe4-4ca0-8b23-212dfabfeec2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:23.292822 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6154f9c2-ffe4-4ca0-8b23-212dfabfeec2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:23.293588 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6154f9c2-ffe4-4ca0-8b23-212dfabfeec2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:23.294027 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6154f9c2-ffe4-4ca0-8b23-212dfabfeec2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:23.295193 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5701f5e4-b30b-4fb2-bb89-0143b4cd879c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:23.295727 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5701f5e4-b30b-4fb2-bb89-0143b4cd879c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:23.296571 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5701f5e4-b30b-4fb2-bb89-0143b4cd879c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:23.297126 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5701f5e4-b30b-4fb2-bb89-0143b4cd879c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:23.302309 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=100 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:23.499683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-6154f9c2-ffe4-4ca0-8b23-212dfabfeec2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:23.502940 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-5701f5e4-b30b-4fb2-bb89-0143b4cd879c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:23.507510 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-6154f9c2-ffe4-4ca0-8b23-212dfabfeec2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.226222 May 26 12:33:23.508405 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 69/137] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:23 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:23.511078 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-5701f5e4-b30b-4fb2-bb89-0143b4cd879c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:23.512599 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-5701f5e4-b30b-4fb2-bb89-0143b4cd879c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:23.513981 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-5701f5e4-b30b-4fb2-bb89-0143b4cd879c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.232702 May 26 12:33:23.515248 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 69/138] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:23 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:33:23.522485 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f4da2236-7350-4602-9bd6-9ceedd2f06ac tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:23.523193 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f4da2236-7350-4602-9bd6-9ceedd2f06ac tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:23.529404 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f4da2236-7350-4602-9bd6-9ceedd2f06ac tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:23.529855 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f4da2236-7350-4602-9bd6-9ceedd2f06ac tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:23.530619 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f4da2236-7350-4602-9bd6-9ceedd2f06ac tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:23.531069 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f4da2236-7350-4602-9bd6-9ceedd2f06ac tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:23.599259 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f4da2236-7350-4602-9bd6-9ceedd2f06ac tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:23.613510 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f4da2236-7350-4602-9bd6-9ceedd2f06ac tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1217 microversion: 2.1 time: 0.093578 May 26 12:33:23.614095 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 70/139] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:23 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:23.898173 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e4a67027-bf78-4537-84d5-27e6b21fb8e2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:23.898784 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-e4a67027-bf78-4537-84d5-27e6b21fb8e2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:23.906727 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e4a67027-bf78-4537-84d5-27e6b21fb8e2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:23.907253 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e4a67027-bf78-4537-84d5-27e6b21fb8e2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:23.907940 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e4a67027-bf78-4537-84d5-27e6b21fb8e2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:23.908378 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e4a67027-bf78-4537-84d5-27e6b21fb8e2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:24.047328 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-e4a67027-bf78-4537-84d5-27e6b21fb8e2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:24.054663 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-e4a67027-bf78-4537-84d5-27e6b21fb8e2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.160382 May 26 12:33:24.055232 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 70/140] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:23 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:24.524500 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-54c613f3-0fc8-4cec-95f6-eb46c6a0e2cc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:24.525160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-54c613f3-0fc8-4cec-95f6-eb46c6a0e2cc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:24.527832 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=4 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:24.528564 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=6 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:24.533008 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-31712899-590e-429b-b7a8-185918083b3c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:24.533824 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-31712899-590e-429b-b7a8-185918083b3c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:24.534470 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-54c613f3-0fc8-4cec-95f6-eb46c6a0e2cc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:24.534922 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-54c613f3-0fc8-4cec-95f6-eb46c6a0e2cc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:24.535695 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-54c613f3-0fc8-4cec-95f6-eb46c6a0e2cc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:24.536137 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-54c613f3-0fc8-4cec-95f6-eb46c6a0e2cc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:24.539741 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-31712899-590e-429b-b7a8-185918083b3c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:24.540181 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-31712899-590e-429b-b7a8-185918083b3c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:24.540959 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-31712899-590e-429b-b7a8-185918083b3c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:24.541778 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-31712899-590e-429b-b7a8-185918083b3c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:24.705922 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell0:SELECT=2 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:24.744987 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-54c613f3-0fc8-4cec-95f6-eb46c6a0e2cc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:24.749079 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-31712899-590e-429b-b7a8-185918083b3c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:24.752448 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-54c613f3-0fc8-4cec-95f6-eb46c6a0e2cc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.231705 May 26 12:33:24.754822 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 71/141] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:24 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:24.766616 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-31712899-590e-429b-b7a8-185918083b3c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:24.768285 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-31712899-590e-429b-b7a8-185918083b3c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:24.768929 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e70da909-0ff8-4ba2-b731-332339877805 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:24.769668 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e70da909-0ff8-4ba2-b731-332339877805 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:24.769793 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-31712899-590e-429b-b7a8-185918083b3c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.241408 May 26 12:33:24.770838 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 71/142] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:24 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:24.776266 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e70da909-0ff8-4ba2-b731-332339877805 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:24.776672 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e70da909-0ff8-4ba2-b731-332339877805 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:24.777454 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e70da909-0ff8-4ba2-b731-332339877805 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:24.777890 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e70da909-0ff8-4ba2-b731-332339877805 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:24.839439 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e70da909-0ff8-4ba2-b731-332339877805 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:24.847652 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e70da909-0ff8-4ba2-b731-332339877805 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1217 microversion: 2.1 time: 0.091866 May 26 12:33:24.848214 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 72/143] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:24 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:25.071596 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-afc34118-2219-4bd9-ba51-9054ac6e4522 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:25.072107 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-afc34118-2219-4bd9-ba51-9054ac6e4522 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:25.079030 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-afc34118-2219-4bd9-ba51-9054ac6e4522 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:25.079472 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-afc34118-2219-4bd9-ba51-9054ac6e4522 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:25.080212 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-afc34118-2219-4bd9-ba51-9054ac6e4522 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:25.080642 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-afc34118-2219-4bd9-ba51-9054ac6e4522 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:25.209446 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-afc34118-2219-4bd9-ba51-9054ac6e4522 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:25.217469 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-afc34118-2219-4bd9-ba51-9054ac6e4522 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.149811 May 26 12:33:25.218025 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 72/144] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:25 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:25.770864 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-21698e79-d716-451d-a135-6a2a35e2ccf6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:25.771453 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-21698e79-d716-451d-a135-6a2a35e2ccf6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:25.778941 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-21698e79-d716-451d-a135-6a2a35e2ccf6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:25.779393 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-21698e79-d716-451d-a135-6a2a35e2ccf6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:25.780232 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-21698e79-d716-451d-a135-6a2a35e2ccf6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:25.780683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-21698e79-d716-451d-a135-6a2a35e2ccf6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:25.788617 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-d1b55139-3efd-4635-b7be-dcec636b210e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:25.789304 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-d1b55139-3efd-4635-b7be-dcec636b210e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:25.795617 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d1b55139-3efd-4635-b7be-dcec636b210e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:25.796063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d1b55139-3efd-4635-b7be-dcec636b210e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:25.796850 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d1b55139-3efd-4635-b7be-dcec636b210e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:25.797290 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d1b55139-3efd-4635-b7be-dcec636b210e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:25.797414 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=100 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:25.983046 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-21698e79-d716-451d-a135-6a2a35e2ccf6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:25.991228 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-21698e79-d716-451d-a135-6a2a35e2ccf6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.224100 May 26 12:33:25.991817 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 73/145] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:25 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:25.992080 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d1b55139-3efd-4635-b7be-dcec636b210e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:25.996778 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-9fec6f0a-4727-49c6-96c7-ba4cceb6e178 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:25.997549 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-9fec6f0a-4727-49c6-96c7-ba4cceb6e178 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:26.000691 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d1b55139-3efd-4635-b7be-dcec636b210e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:26.002334 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d1b55139-3efd-4635-b7be-dcec636b210e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:26.003436 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-d1b55139-3efd-4635-b7be-dcec636b210e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.218874 May 26 12:33:26.003993 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 73/146] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:25 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:33:26.004183 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9fec6f0a-4727-49c6-96c7-ba4cceb6e178 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:26.004617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9fec6f0a-4727-49c6-96c7-ba4cceb6e178 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:26.005682 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9fec6f0a-4727-49c6-96c7-ba4cceb6e178 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:26.006127 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9fec6f0a-4727-49c6-96c7-ba4cceb6e178 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:26.084564 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-9fec6f0a-4727-49c6-96c7-ba4cceb6e178 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:26.095771 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-9fec6f0a-4727-49c6-96c7-ba4cceb6e178 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1217 microversion: 2.1 time: 0.102940 May 26 12:33:26.096367 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 74/147] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:25 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:26.234400 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-87b31e2b-59be-4604-8700-9ca22d916e69 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:26.235134 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-87b31e2b-59be-4604-8700-9ca22d916e69 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:26.245210 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-87b31e2b-59be-4604-8700-9ca22d916e69 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:26.245777 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-87b31e2b-59be-4604-8700-9ca22d916e69 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:26.246544 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-87b31e2b-59be-4604-8700-9ca22d916e69 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:26.246978 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-87b31e2b-59be-4604-8700-9ca22d916e69 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:26.389962 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-87b31e2b-59be-4604-8700-9ca22d916e69 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:26.397854 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-87b31e2b-59be-4604-8700-9ca22d916e69 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.167197 May 26 12:33:26.398382 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 74/148] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:26 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:27.009338 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-eec92d31-0728-4aa2-a8a2-f91aa0a1c0f6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:27.009877 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-eec92d31-0728-4aa2-a8a2-f91aa0a1c0f6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:27.016758 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-eec92d31-0728-4aa2-a8a2-f91aa0a1c0f6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:27.017210 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-eec92d31-0728-4aa2-a8a2-f91aa0a1c0f6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:27.017976 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-eec92d31-0728-4aa2-a8a2-f91aa0a1c0f6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:27.018414 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-eec92d31-0728-4aa2-a8a2-f91aa0a1c0f6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:27.021063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-d047a53a-8346-43d3-8074-e0eebbca2243 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:27.021672 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-d047a53a-8346-43d3-8074-e0eebbca2243 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:27.028355 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d047a53a-8346-43d3-8074-e0eebbca2243 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:27.028847 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d047a53a-8346-43d3-8074-e0eebbca2243 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:27.029614 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d047a53a-8346-43d3-8074-e0eebbca2243 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:27.030057 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d047a53a-8346-43d3-8074-e0eebbca2243 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:27.214784 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-eec92d31-0728-4aa2-a8a2-f91aa0a1c0f6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:27.221563 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d047a53a-8346-43d3-8074-e0eebbca2243 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:27.223929 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-eec92d31-0728-4aa2-a8a2-f91aa0a1c0f6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.219379 May 26 12:33:27.224966 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 75/149] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:27 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:27.231055 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-b318a1ce-aae9-405e-9783-66d6a8e8bb31 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:27.231850 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-b318a1ce-aae9-405e-9783-66d6a8e8bb31 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:27.238290 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b318a1ce-aae9-405e-9783-66d6a8e8bb31 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:27.238768 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b318a1ce-aae9-405e-9783-66d6a8e8bb31 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:27.239533 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b318a1ce-aae9-405e-9783-66d6a8e8bb31 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:27.239651 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d047a53a-8346-43d3-8074-e0eebbca2243 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:27.240099 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b318a1ce-aae9-405e-9783-66d6a8e8bb31 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:27.241446 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d047a53a-8346-43d3-8074-e0eebbca2243 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:27.242664 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-d047a53a-8346-43d3-8074-e0eebbca2243 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.225405 May 26 12:33:27.243319 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 75/150] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:27 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:33:27.301582 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-db7d25c3-798d-4a1e-a7ee-a016641f0911 req-9b6ae3e4-b4bd-438d-8b91-15674c366682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cfc21dd-efee-45cb-9462-cdd0025a5038", "name": "network-vif-plugged", "status": "completed", "tag": "c4a31d7d-0831-4fea-a609-85371a2084a6"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:33:27.312643 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-db7d25c3-798d-4a1e-a7ee-a016641f0911 req-9b6ae3e4-b4bd-438d-8b91-15674c366682 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:27.313641 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-db7d25c3-798d-4a1e-a7ee-a016641f0911 req-9b6ae3e4-b4bd-438d-8b91-15674c366682 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:27.313998 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-b318a1ce-aae9-405e-9783-66d6a8e8bb31 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:27.322786 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-b318a1ce-aae9-405e-9783-66d6a8e8bb31 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1217 microversion: 2.1 time: 0.096137 May 26 12:33:27.323718 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 76/151] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:27 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:27.327827 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-db7d25c3-798d-4a1e-a7ee-a016641f0911 req-9b6ae3e4-b4bd-438d-8b91-15674c366682 service nova] Creating event network-vif-plugged:c4a31d7d-0831-4fea-a609-85371a2084a6 for instance 1cfc21dd-efee-45cb-9462-cdd0025a5038 on hv-cinder-81514 May 26 12:33:27.334194 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-db7d25c3-798d-4a1e-a7ee-a016641f0911 req-9b6ae3e4-b4bd-438d-8b91-15674c366682 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036403 May 26 12:33:27.334803 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 76/152] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:33:27.415069 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-7f98068f-086e-4f4c-9bbe-9d5fbeb44441 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:27.415704 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-7f98068f-086e-4f4c-9bbe-9d5fbeb44441 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:27.422251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7f98068f-086e-4f4c-9bbe-9d5fbeb44441 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:27.422694 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7f98068f-086e-4f4c-9bbe-9d5fbeb44441 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:27.423448 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7f98068f-086e-4f4c-9bbe-9d5fbeb44441 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:27.423883 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7f98068f-086e-4f4c-9bbe-9d5fbeb44441 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:27.553499 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-7f98068f-086e-4f4c-9bbe-9d5fbeb44441 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:27.561672 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-7f98068f-086e-4f4c-9bbe-9d5fbeb44441 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.150277 May 26 12:33:27.562345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 77/153] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:27 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:28.241734 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-8f1861e9-bec6-476c-bdfe-7724088f7d3d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:28.242424 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-8f1861e9-bec6-476c-bdfe-7724088f7d3d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:28.248985 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8f1861e9-bec6-476c-bdfe-7724088f7d3d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:28.249436 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8f1861e9-bec6-476c-bdfe-7724088f7d3d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:28.250186 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8f1861e9-bec6-476c-bdfe-7724088f7d3d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:28.250622 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8f1861e9-bec6-476c-bdfe-7724088f7d3d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:28.261195 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-4eb28b7a-739d-4627-9ec3-b54aeb6e1feb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:28.261971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-4eb28b7a-739d-4627-9ec3-b54aeb6e1feb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:28.268530 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4eb28b7a-739d-4627-9ec3-b54aeb6e1feb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:28.269086 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4eb28b7a-739d-4627-9ec3-b54aeb6e1feb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:28.269885 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4eb28b7a-739d-4627-9ec3-b54aeb6e1feb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:28.270320 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4eb28b7a-739d-4627-9ec3-b54aeb6e1feb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:28.462192 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-8f1861e9-bec6-476c-bdfe-7724088f7d3d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:28.469710 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-4eb28b7a-739d-4627-9ec3-b54aeb6e1feb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:28.469894 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-8f1861e9-bec6-476c-bdfe-7724088f7d3d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.232283 May 26 12:33:28.470469 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 77/154] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:28 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:28.475057 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-c937b4c2-21a7-455a-a54d-4e15017ce358 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:28.475646 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-c937b4c2-21a7-455a-a54d-4e15017ce358 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:28.478652 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-4eb28b7a-739d-4627-9ec3-b54aeb6e1feb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:28.480504 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-4eb28b7a-739d-4627-9ec3-b54aeb6e1feb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:28.481629 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-4eb28b7a-739d-4627-9ec3-b54aeb6e1feb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.224969 May 26 12:33:28.481747 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c937b4c2-21a7-455a-a54d-4e15017ce358 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:28.482179 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c937b4c2-21a7-455a-a54d-4e15017ce358 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:28.482265 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 78/155] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:28 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:33:28.482930 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c937b4c2-21a7-455a-a54d-4e15017ce358 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:28.483413 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c937b4c2-21a7-455a-a54d-4e15017ce358 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:28.544101 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c937b4c2-21a7-455a-a54d-4e15017ce358 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:28.551454 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-c937b4c2-21a7-455a-a54d-4e15017ce358 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1217 microversion: 2.1 time: 0.079998 May 26 12:33:28.551937 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 78/156] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:28 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:28.579144 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f0ce3a41-2b26-4549-ad69-a31689bfd41e tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:28.580066 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f0ce3a41-2b26-4549-ad69-a31689bfd41e tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:28.586221 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f0ce3a41-2b26-4549-ad69-a31689bfd41e tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:28.586666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f0ce3a41-2b26-4549-ad69-a31689bfd41e tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:28.587414 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f0ce3a41-2b26-4549-ad69-a31689bfd41e tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:28.587912 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f0ce3a41-2b26-4549-ad69-a31689bfd41e tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:28.734692 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f0ce3a41-2b26-4549-ad69-a31689bfd41e tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:28.742531 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f0ce3a41-2b26-4549-ad69-a31689bfd41e tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.167121 May 26 12:33:28.743100 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 79/157] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:28 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:29.405837 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-7170b787-b875-4b0b-b0bc-e40c7e8f5f6b tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "174ca190-e513-488f-a576-fbb2408835d3"}} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:33:29.406967 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-7170b787-b875-4b0b-b0bc-e40c7e8f5f6b tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:29.413025 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7170b787-b875-4b0b-b0bc-e40c7e8f5f6b tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:29.413468 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7170b787-b875-4b0b-b0bc-e40c7e8f5f6b tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:29.414211 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7170b787-b875-4b0b-b0bc-e40c7e8f5f6b tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:29.414640 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7170b787-b875-4b0b-b0bc-e40c7e8f5f6b tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:29.486110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-dd7f3b5e-f925-4037-a75a-14e231e0d55a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:29.486638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-dd7f3b5e-f925-4037-a75a-14e231e0d55a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:29.492799 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dd7f3b5e-f925-4037-a75a-14e231e0d55a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:29.493257 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dd7f3b5e-f925-4037-a75a-14e231e0d55a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:29.494121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dd7f3b5e-f925-4037-a75a-14e231e0d55a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:29.494639 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dd7f3b5e-f925-4037-a75a-14e231e0d55a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:29.628612 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-dd7f3b5e-f925-4037-a75a-14e231e0d55a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:29.636510 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-dd7f3b5e-f925-4037-a75a-14e231e0d55a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.154236 May 26 12:33:29.637094 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 80/158] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:29 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:29.641892 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-3031b8c3-d4ec-4a38-b798-9699c4cb6b42 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:29.642516 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-3031b8c3-d4ec-4a38-b798-9699c4cb6b42 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:29.648020 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3031b8c3-d4ec-4a38-b798-9699c4cb6b42 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:29.648468 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3031b8c3-d4ec-4a38-b798-9699c4cb6b42 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:29.649250 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3031b8c3-d4ec-4a38-b798-9699c4cb6b42 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:29.649687 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3031b8c3-d4ec-4a38-b798-9699c4cb6b42 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:29.780618 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-3031b8c3-d4ec-4a38-b798-9699c4cb6b42 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:29.788541 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-3031b8c3-d4ec-4a38-b798-9699c4cb6b42 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:29.790090 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-3031b8c3-d4ec-4a38-b798-9699c4cb6b42 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:29.791258 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-3031b8c3-d4ec-4a38-b798-9699c4cb6b42 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.153172 May 26 12:33:29.791889 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 81/159] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:29 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:29.796205 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-c5280b04-927f-4ad5-a97c-1f355ed6fb90 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:29.796827 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-c5280b04-927f-4ad5-a97c-1f355ed6fb90 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:29.802622 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c5280b04-927f-4ad5-a97c-1f355ed6fb90 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:29.803074 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c5280b04-927f-4ad5-a97c-1f355ed6fb90 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:29.803835 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c5280b04-927f-4ad5-a97c-1f355ed6fb90 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:29.804274 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c5280b04-927f-4ad5-a97c-1f355ed6fb90 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:29.863786 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-c5280b04-927f-4ad5-a97c-1f355ed6fb90 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:29.872009 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-c5280b04-927f-4ad5-a97c-1f355ed6fb90 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1209 microversion: 2.1 time: 0.079064 May 26 12:33:29.872783 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 82/160] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:29 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1209 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:29.877831 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-df46da11-827f-4abd-a550-78564ac963bd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:29.878627 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-df46da11-827f-4abd-a550-78564ac963bd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:29.892369 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-df46da11-827f-4abd-a550-78564ac963bd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:29.892472 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-df46da11-827f-4abd-a550-78564ac963bd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:29.893277 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-df46da11-827f-4abd-a550-78564ac963bd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:29.893723 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-df46da11-827f-4abd-a550-78564ac963bd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:30.022681 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-df46da11-827f-4abd-a550-78564ac963bd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:30.031302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-df46da11-827f-4abd-a550-78564ac963bd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.157503 May 26 12:33:30.031791 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 83/161] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:29 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:30.653007 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-690b289a-c2fe-464d-8894-78f71e378371 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:30.653763 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-690b289a-c2fe-464d-8894-78f71e378371 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:30.660151 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-690b289a-c2fe-464d-8894-78f71e378371 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:30.660601 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-690b289a-c2fe-464d-8894-78f71e378371 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:30.661379 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-690b289a-c2fe-464d-8894-78f71e378371 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:30.661818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-690b289a-c2fe-464d-8894-78f71e378371 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:30.791265 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-690b289a-c2fe-464d-8894-78f71e378371 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:30.798523 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-690b289a-c2fe-464d-8894-78f71e378371 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.149514 May 26 12:33:30.799077 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 84/162] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:30 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:30.808230 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f80005b9-2bc7-450b-baba-cb6750120c3d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:30.808847 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f80005b9-2bc7-450b-baba-cb6750120c3d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:30.814464 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f80005b9-2bc7-450b-baba-cb6750120c3d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:30.814904 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f80005b9-2bc7-450b-baba-cb6750120c3d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:30.815666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f80005b9-2bc7-450b-baba-cb6750120c3d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:30.816084 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f80005b9-2bc7-450b-baba-cb6750120c3d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:30.945105 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f80005b9-2bc7-450b-baba-cb6750120c3d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:30.953567 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f80005b9-2bc7-450b-baba-cb6750120c3d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:30.955091 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f80005b9-2bc7-450b-baba-cb6750120c3d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:30.956176 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f80005b9-2bc7-450b-baba-cb6750120c3d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.151928 May 26 12:33:30.956732 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 85/163] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:30 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:33:30.961031 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-a2167899-04f2-480b-94bc-3aa7649f5acf tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:30.961624 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-a2167899-04f2-480b-94bc-3aa7649f5acf tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:30.967216 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a2167899-04f2-480b-94bc-3aa7649f5acf tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:30.967664 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a2167899-04f2-480b-94bc-3aa7649f5acf tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:30.968417 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a2167899-04f2-480b-94bc-3aa7649f5acf tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:30.968885 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a2167899-04f2-480b-94bc-3aa7649f5acf tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:31.163913 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-a2167899-04f2-480b-94bc-3aa7649f5acf tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:31.171866 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-a2167899-04f2-480b-94bc-3aa7649f5acf tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1209 microversion: 2.1 time: 0.214127 May 26 12:33:31.172356 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 86/164] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:30 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1209 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:31.176615 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-c6d965c6-6a52-4157-8fb0-09c8e920d1b7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:31.177235 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-c6d965c6-6a52-4157-8fb0-09c8e920d1b7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:31.183296 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c6d965c6-6a52-4157-8fb0-09c8e920d1b7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:31.183744 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c6d965c6-6a52-4157-8fb0-09c8e920d1b7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:31.184491 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c6d965c6-6a52-4157-8fb0-09c8e920d1b7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:31.184961 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c6d965c6-6a52-4157-8fb0-09c8e920d1b7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:31.363227 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-c6d965c6-6a52-4157-8fb0-09c8e920d1b7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:31.374756 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-c6d965c6-6a52-4157-8fb0-09c8e920d1b7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.201330 May 26 12:33:31.375526 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 87/165] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:31 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:31.815623 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-c5c95af0-4599-4d71-be79-bc9b5c7c390c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:31.816209 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-c5c95af0-4599-4d71-be79-bc9b5c7c390c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:31.822794 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c5c95af0-4599-4d71-be79-bc9b5c7c390c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:31.823207 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c5c95af0-4599-4d71-be79-bc9b5c7c390c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:31.823961 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c5c95af0-4599-4d71-be79-bc9b5c7c390c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:31.824397 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c5c95af0-4599-4d71-be79-bc9b5c7c390c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:31.954476 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-c5c95af0-4599-4d71-be79-bc9b5c7c390c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:31.961798 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-c5c95af0-4599-4d71-be79-bc9b5c7c390c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.149970 May 26 12:33:31.962353 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 88/166] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:31 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:31.973979 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d9a074e7-256c-4bbc-89a0-ad92acead843 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:31.974574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d9a074e7-256c-4bbc-89a0-ad92acead843 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:31.981189 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d9a074e7-256c-4bbc-89a0-ad92acead843 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:31.981635 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d9a074e7-256c-4bbc-89a0-ad92acead843 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:31.982386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d9a074e7-256c-4bbc-89a0-ad92acead843 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:31.982820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d9a074e7-256c-4bbc-89a0-ad92acead843 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:32.111343 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d9a074e7-256c-4bbc-89a0-ad92acead843 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:32.120041 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d9a074e7-256c-4bbc-89a0-ad92acead843 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:32.121980 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d9a074e7-256c-4bbc-89a0-ad92acead843 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:32.123063 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-d9a074e7-256c-4bbc-89a0-ad92acead843 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.152677 May 26 12:33:32.123608 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 89/167] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:31 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:33:32.192473 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-60a7c5d7-b44f-4c8d-815d-ac195cb19876 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:32.193101 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-60a7c5d7-b44f-4c8d-815d-ac195cb19876 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:32.199112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-60a7c5d7-b44f-4c8d-815d-ac195cb19876 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:32.199551 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-60a7c5d7-b44f-4c8d-815d-ac195cb19876 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:32.200300 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-60a7c5d7-b44f-4c8d-815d-ac195cb19876 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:32.200753 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-60a7c5d7-b44f-4c8d-815d-ac195cb19876 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:32.203265 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=100 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:32.261517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-60a7c5d7-b44f-4c8d-815d-ac195cb19876 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:32.269001 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-60a7c5d7-b44f-4c8d-815d-ac195cb19876 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1209 microversion: 2.1 time: 0.084164 May 26 12:33:32.269578 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 90/168] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:32 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1209 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:32.391635 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-38bbbb1e-8f10-4b6a-8252-898113e1d79a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:32.392240 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-38bbbb1e-8f10-4b6a-8252-898113e1d79a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:32.398746 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-38bbbb1e-8f10-4b6a-8252-898113e1d79a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:32.399201 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-38bbbb1e-8f10-4b6a-8252-898113e1d79a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:32.399962 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-38bbbb1e-8f10-4b6a-8252-898113e1d79a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:32.401077 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-38bbbb1e-8f10-4b6a-8252-898113e1d79a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:32.532702 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-38bbbb1e-8f10-4b6a-8252-898113e1d79a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:32.541018 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-38bbbb1e-8f10-4b6a-8252-898113e1d79a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.153257 May 26 12:33:32.541806 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 91/169] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:32 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:32.978940 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ff4551b8-5274-4c62-9210-4e675e50c0ed tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:32.980364 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ff4551b8-5274-4c62-9210-4e675e50c0ed tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:32.987815 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ff4551b8-5274-4c62-9210-4e675e50c0ed tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:32.989583 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ff4551b8-5274-4c62-9210-4e675e50c0ed tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:32.991702 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ff4551b8-5274-4c62-9210-4e675e50c0ed tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:32.992364 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ff4551b8-5274-4c62-9210-4e675e50c0ed tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:33.200205 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ff4551b8-5274-4c62-9210-4e675e50c0ed tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:33.207745 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ff4551b8-5274-4c62-9210-4e675e50c0ed tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.233243 May 26 12:33:33.208504 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 92/170] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:32 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:33.221653 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-1c39e17d-1204-4d65-9842-beebb5adc334 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:33.222265 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-1c39e17d-1204-4d65-9842-beebb5adc334 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:33.228707 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1c39e17d-1204-4d65-9842-beebb5adc334 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:33.229196 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1c39e17d-1204-4d65-9842-beebb5adc334 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:33.229957 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1c39e17d-1204-4d65-9842-beebb5adc334 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:33.230393 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1c39e17d-1204-4d65-9842-beebb5adc334 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:33.361512 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-1c39e17d-1204-4d65-9842-beebb5adc334 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:33.370696 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-1c39e17d-1204-4d65-9842-beebb5adc334 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:33.372235 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-1c39e17d-1204-4d65-9842-beebb5adc334 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:33.373542 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-1c39e17d-1204-4d65-9842-beebb5adc334 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.155462 May 26 12:33:33.374096 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 93/171] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:33 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:33.384373 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-76ffc72e-7c7d-43f0-ae3f-510e304a21a5 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:33.384373 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-76ffc72e-7c7d-43f0-ae3f-510e304a21a5 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:33.385900 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-76ffc72e-7c7d-43f0-ae3f-510e304a21a5 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:33.386043 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-76ffc72e-7c7d-43f0-ae3f-510e304a21a5 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:33.386814 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-76ffc72e-7c7d-43f0-ae3f-510e304a21a5 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:33.387259 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-76ffc72e-7c7d-43f0-ae3f-510e304a21a5 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:33.458635 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-76ffc72e-7c7d-43f0-ae3f-510e304a21a5 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:33.466208 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-76ffc72e-7c7d-43f0-ae3f-510e304a21a5 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1265 microversion: 2.1 time: 0.091151 May 26 12:33:33.466759 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 94/172] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:33 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:33.558498 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-fedd17e0-cb34-43a7-a459-00aabbc25339 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:33.559111 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-fedd17e0-cb34-43a7-a459-00aabbc25339 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:33.565168 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fedd17e0-cb34-43a7-a459-00aabbc25339 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:33.565622 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fedd17e0-cb34-43a7-a459-00aabbc25339 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:33.566500 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fedd17e0-cb34-43a7-a459-00aabbc25339 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:33.566939 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fedd17e0-cb34-43a7-a459-00aabbc25339 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:33.990092 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-7170b787-b875-4b0b-b0bc-e40c7e8f5f6b tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "POST /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.587808 May 26 12:33:33.990843 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 79/173] 10.222.0.39 () {60 vars in 1322 bytes} [Thu May 26 12:33:29 2022] POST /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1/os-volume_attachments => generated 194 bytes in 4590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:33:34.077379 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-fedd17e0-cb34-43a7-a459-00aabbc25339 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:34.085398 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-fedd17e0-cb34-43a7-a459-00aabbc25339 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.531811 May 26 12:33:34.085940 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 95/174] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:33 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:34.225832 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-0d0bf24b-a43e-4dc0-b813-676796a2318b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:34.226598 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-0d0bf24b-a43e-4dc0-b813-676796a2318b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:34.233704 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0d0bf24b-a43e-4dc0-b813-676796a2318b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:34.234153 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0d0bf24b-a43e-4dc0-b813-676796a2318b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:34.234908 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0d0bf24b-a43e-4dc0-b813-676796a2318b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:34.235344 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0d0bf24b-a43e-4dc0-b813-676796a2318b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:34.372206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-0d0bf24b-a43e-4dc0-b813-676796a2318b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:34.379510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-0d0bf24b-a43e-4dc0-b813-676796a2318b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.158322 May 26 12:33:34.380060 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 80/175] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:34 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:34.391677 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-cd129b81-b11e-4b62-851d-d13cfacc62e9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:34.392288 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-cd129b81-b11e-4b62-851d-d13cfacc62e9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:34.398272 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cd129b81-b11e-4b62-851d-d13cfacc62e9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:34.398762 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cd129b81-b11e-4b62-851d-d13cfacc62e9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:34.399523 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cd129b81-b11e-4b62-851d-d13cfacc62e9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:34.400505 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cd129b81-b11e-4b62-851d-d13cfacc62e9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:34.485495 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-8524d8d8-aae4-4337-9577-de7b3bc9f5dd tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:34.486342 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-8524d8d8-aae4-4337-9577-de7b3bc9f5dd tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:34.495601 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8524d8d8-aae4-4337-9577-de7b3bc9f5dd tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:34.496274 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8524d8d8-aae4-4337-9577-de7b3bc9f5dd tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:34.497970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8524d8d8-aae4-4337-9577-de7b3bc9f5dd tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:34.498723 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8524d8d8-aae4-4337-9577-de7b3bc9f5dd tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:34.539780 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-cd129b81-b11e-4b62-851d-d13cfacc62e9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:34.550256 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-cd129b81-b11e-4b62-851d-d13cfacc62e9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:34.552062 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-cd129b81-b11e-4b62-851d-d13cfacc62e9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:34.553296 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-cd129b81-b11e-4b62-851d-d13cfacc62e9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.165786 May 26 12:33:34.554326 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 96/176] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:34 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:34.574340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-8524d8d8-aae4-4337-9577-de7b3bc9f5dd tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:34.588481 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-8524d8d8-aae4-4337-9577-de7b3bc9f5dd tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1265 microversion: 2.1 time: 0.108769 May 26 12:33:34.589165 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 81/177] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:34 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1265 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:35.103089 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-308b9106-df1d-4e85-8ba4-a7c4ea53871f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:35.103752 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-308b9106-df1d-4e85-8ba4-a7c4ea53871f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:35.109933 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-308b9106-df1d-4e85-8ba4-a7c4ea53871f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:35.110463 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-308b9106-df1d-4e85-8ba4-a7c4ea53871f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:35.111285 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-308b9106-df1d-4e85-8ba4-a7c4ea53871f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:35.111725 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-308b9106-df1d-4e85-8ba4-a7c4ea53871f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:35.240685 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-308b9106-df1d-4e85-8ba4-a7c4ea53871f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:35.248587 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-308b9106-df1d-4e85-8ba4-a7c4ea53871f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.149398 May 26 12:33:35.249173 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 97/178] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:35 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:35.396528 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-edbd969c-1aef-44ce-bf6d-2eabdb5bc3ab tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:35.397159 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-edbd969c-1aef-44ce-bf6d-2eabdb5bc3ab tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:35.403898 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-edbd969c-1aef-44ce-bf6d-2eabdb5bc3ab tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:35.404343 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-edbd969c-1aef-44ce-bf6d-2eabdb5bc3ab tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:35.405129 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-edbd969c-1aef-44ce-bf6d-2eabdb5bc3ab tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:35.405561 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-edbd969c-1aef-44ce-bf6d-2eabdb5bc3ab tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:35.532980 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-edbd969c-1aef-44ce-bf6d-2eabdb5bc3ab tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:35.540243 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-edbd969c-1aef-44ce-bf6d-2eabdb5bc3ab tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.147527 May 26 12:33:35.541518 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 82/179] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:35 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:35.571795 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-986f210d-feef-48c4-af4c-92a7ac0e9c71 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:35.572494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-986f210d-feef-48c4-af4c-92a7ac0e9c71 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:35.578922 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-986f210d-feef-48c4-af4c-92a7ac0e9c71 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:35.579306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-986f210d-feef-48c4-af4c-92a7ac0e9c71 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:35.580063 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-986f210d-feef-48c4-af4c-92a7ac0e9c71 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:35.580524 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-986f210d-feef-48c4-af4c-92a7ac0e9c71 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:35.605005 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-c4b61939-a9ad-4eea-b685-61ee0c71e940 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:35.605721 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-c4b61939-a9ad-4eea-b685-61ee0c71e940 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:35.611703 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c4b61939-a9ad-4eea-b685-61ee0c71e940 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:35.612149 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c4b61939-a9ad-4eea-b685-61ee0c71e940 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:35.612947 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c4b61939-a9ad-4eea-b685-61ee0c71e940 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:35.613384 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c4b61939-a9ad-4eea-b685-61ee0c71e940 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:35.685265 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c4b61939-a9ad-4eea-b685-61ee0c71e940 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:35.692693 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-c4b61939-a9ad-4eea-b685-61ee0c71e940 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1265 microversion: 2.1 time: 0.092043 May 26 12:33:35.693282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 83/180] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:35 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1265 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:35.740076 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-986f210d-feef-48c4-af4c-92a7ac0e9c71 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:35.749154 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-986f210d-feef-48c4-af4c-92a7ac0e9c71 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:35.750666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-986f210d-feef-48c4-af4c-92a7ac0e9c71 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:35.751738 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-986f210d-feef-48c4-af4c-92a7ac0e9c71 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.184142 May 26 12:33:35.752286 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 98/181] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:35 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:36.265627 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e8aa11e6-2672-4f86-9c58-899d4aa01408 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:36.266227 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-e8aa11e6-2672-4f86-9c58-899d4aa01408 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:36.272183 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e8aa11e6-2672-4f86-9c58-899d4aa01408 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:36.272629 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e8aa11e6-2672-4f86-9c58-899d4aa01408 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:36.273408 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e8aa11e6-2672-4f86-9c58-899d4aa01408 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:36.273841 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e8aa11e6-2672-4f86-9c58-899d4aa01408 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:36.408272 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-e8aa11e6-2672-4f86-9c58-899d4aa01408 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:36.415798 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-e8aa11e6-2672-4f86-9c58-899d4aa01408 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.154110 May 26 12:33:36.416736 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 84/182] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:36 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:36.557435 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-4f6ec4b6-7afb-4f23-8f5e-781480d2cf32 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:36.558046 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-4f6ec4b6-7afb-4f23-8f5e-781480d2cf32 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:36.564098 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4f6ec4b6-7afb-4f23-8f5e-781480d2cf32 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:36.564546 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4f6ec4b6-7afb-4f23-8f5e-781480d2cf32 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:36.565331 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4f6ec4b6-7afb-4f23-8f5e-781480d2cf32 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:36.565770 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4f6ec4b6-7afb-4f23-8f5e-781480d2cf32 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:36.604547 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-5ddfc9ab-d509-42ee-96aa-580f006b99c9 req-424b5e2d-9ec7-4082-87ef-0d35f54a1821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7af16d0b-59c7-43ea-856c-ec79029b680c", "name": "network-vif-plugged", "status": "completed", "tag": "b1b5ee45-e743-4819-bc49-534e21eec9a7"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:33:36.613619 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-5ddfc9ab-d509-42ee-96aa-580f006b99c9 req-424b5e2d-9ec7-4082-87ef-0d35f54a1821 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:36.614059 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-5ddfc9ab-d509-42ee-96aa-580f006b99c9 req-424b5e2d-9ec7-4082-87ef-0d35f54a1821 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:36.620611 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:36.629933 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-5ddfc9ab-d509-42ee-96aa-580f006b99c9 req-424b5e2d-9ec7-4082-87ef-0d35f54a1821 service nova] Creating event network-vif-plugged:b1b5ee45-e743-4819-bc49-534e21eec9a7 for instance 7af16d0b-59c7-43ea-856c-ec79029b680c on hv-cinder-81514 May 26 12:33:36.636005 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-5ddfc9ab-d509-42ee-96aa-580f006b99c9 req-424b5e2d-9ec7-4082-87ef-0d35f54a1821 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034972 May 26 12:33:36.636601 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 85/183] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:33:36.706437 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-4f6ec4b6-7afb-4f23-8f5e-781480d2cf32 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:36.710910 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-720bad32-915c-45a4-90b5-99f97407b12c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:36.711611 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-720bad32-915c-45a4-90b5-99f97407b12c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:36.715462 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-4f6ec4b6-7afb-4f23-8f5e-781480d2cf32 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.162127 May 26 12:33:36.716030 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 99/184] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:36 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:36.719294 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-720bad32-915c-45a4-90b5-99f97407b12c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:36.719747 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-720bad32-915c-45a4-90b5-99f97407b12c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:36.720514 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-720bad32-915c-45a4-90b5-99f97407b12c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:36.721049 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-720bad32-915c-45a4-90b5-99f97407b12c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:36.769740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-8c978c3c-57f1-40e0-95bc-fda07d83a53b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:36.770376 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-8c978c3c-57f1-40e0-95bc-fda07d83a53b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:36.776945 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8c978c3c-57f1-40e0-95bc-fda07d83a53b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:36.777399 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8c978c3c-57f1-40e0-95bc-fda07d83a53b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:36.778160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8c978c3c-57f1-40e0-95bc-fda07d83a53b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:36.778630 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8c978c3c-57f1-40e0-95bc-fda07d83a53b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:36.786464 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-720bad32-915c-45a4-90b5-99f97407b12c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:36.794990 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-720bad32-915c-45a4-90b5-99f97407b12c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1265 microversion: 2.1 time: 0.089810 May 26 12:33:36.795562 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 86/185] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:36 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:36.910580 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-8c978c3c-57f1-40e0-95bc-fda07d83a53b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:36.918638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-8c978c3c-57f1-40e0-95bc-fda07d83a53b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:36.920074 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-8c978c3c-57f1-40e0-95bc-fda07d83a53b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:36.921182 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-8c978c3c-57f1-40e0-95bc-fda07d83a53b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.155302 May 26 12:33:36.921753 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 100/186] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:36 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:37.433366 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-1e1158ca-0412-40e5-ba9c-de6d476ff135 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:37.433984 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-1e1158ca-0412-40e5-ba9c-de6d476ff135 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:37.440490 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1e1158ca-0412-40e5-ba9c-de6d476ff135 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:37.440920 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1e1158ca-0412-40e5-ba9c-de6d476ff135 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:37.441683 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1e1158ca-0412-40e5-ba9c-de6d476ff135 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:37.442128 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1e1158ca-0412-40e5-ba9c-de6d476ff135 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:37.567998 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-1e1158ca-0412-40e5-ba9c-de6d476ff135 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:37.575990 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-1e1158ca-0412-40e5-ba9c-de6d476ff135 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.147184 May 26 12:33:37.576552 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 87/187] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:37 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:37.732257 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e90d4d65-1f1d-44c8-9ea5-24014d6a9bd7 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:37.732881 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e90d4d65-1f1d-44c8-9ea5-24014d6a9bd7 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:37.738916 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e90d4d65-1f1d-44c8-9ea5-24014d6a9bd7 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:37.739361 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e90d4d65-1f1d-44c8-9ea5-24014d6a9bd7 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:37.740113 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e90d4d65-1f1d-44c8-9ea5-24014d6a9bd7 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:37.740546 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e90d4d65-1f1d-44c8-9ea5-24014d6a9bd7 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:37.812232 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-eacfd746-5dff-482d-805d-45439d8b5580 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:37.812899 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-eacfd746-5dff-482d-805d-45439d8b5580 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:37.819605 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-eacfd746-5dff-482d-805d-45439d8b5580 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:37.820062 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-eacfd746-5dff-482d-805d-45439d8b5580 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:37.820865 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-eacfd746-5dff-482d-805d-45439d8b5580 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:37.821308 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-eacfd746-5dff-482d-805d-45439d8b5580 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:37.896499 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-eacfd746-5dff-482d-805d-45439d8b5580 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:37.904487 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-eacfd746-5dff-482d-805d-45439d8b5580 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1265 microversion: 2.1 time: 0.096612 May 26 12:33:37.904770 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e90d4d65-1f1d-44c8-9ea5-24014d6a9bd7 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:37.905096 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 88/188] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:37 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:37.912252 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e90d4d65-1f1d-44c8-9ea5-24014d6a9bd7 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.184852 May 26 12:33:37.912897 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 101/189] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:37 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:37.939607 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e87c8375-4d8a-4aeb-9bdb-340155d32c1a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:37.940443 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-e87c8375-4d8a-4aeb-9bdb-340155d32c1a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:37.946512 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e87c8375-4d8a-4aeb-9bdb-340155d32c1a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:37.947445 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e87c8375-4d8a-4aeb-9bdb-340155d32c1a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:37.948202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e87c8375-4d8a-4aeb-9bdb-340155d32c1a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:37.948644 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e87c8375-4d8a-4aeb-9bdb-340155d32c1a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:38.074715 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-e87c8375-4d8a-4aeb-9bdb-340155d32c1a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:38.082711 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-e87c8375-4d8a-4aeb-9bdb-340155d32c1a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:38.084238 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-e87c8375-4d8a-4aeb-9bdb-340155d32c1a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:38.085368 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-e87c8375-4d8a-4aeb-9bdb-340155d32c1a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.149682 May 26 12:33:38.085922 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 89/190] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:37 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:38.593479 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-89b14a1c-bbaf-4dda-a00d-8d1f9f4ea32f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:38.594013 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-89b14a1c-bbaf-4dda-a00d-8d1f9f4ea32f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:38.599981 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-89b14a1c-bbaf-4dda-a00d-8d1f9f4ea32f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:38.600428 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-89b14a1c-bbaf-4dda-a00d-8d1f9f4ea32f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:38.601225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-89b14a1c-bbaf-4dda-a00d-8d1f9f4ea32f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:38.601662 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-89b14a1c-bbaf-4dda-a00d-8d1f9f4ea32f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:38.734334 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-89b14a1c-bbaf-4dda-a00d-8d1f9f4ea32f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:38.741754 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-89b14a1c-bbaf-4dda-a00d-8d1f9f4ea32f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.152223 May 26 12:33:38.742306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 102/191] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:38 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:38.921889 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-580be676-44a4-4266-879b-a72c22870e70 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:38.922527 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-580be676-44a4-4266-879b-a72c22870e70 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:38.928640 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-bfde5b4d-bf3e-47e1-a013-b31d04eb924e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:38.929224 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-580be676-44a4-4266-879b-a72c22870e70 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:38.929338 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-bfde5b4d-bf3e-47e1-a013-b31d04eb924e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:38.929672 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-580be676-44a4-4266-879b-a72c22870e70 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:38.930435 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-580be676-44a4-4266-879b-a72c22870e70 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:38.930879 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-580be676-44a4-4266-879b-a72c22870e70 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:38.935883 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bfde5b4d-bf3e-47e1-a013-b31d04eb924e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:38.936343 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bfde5b4d-bf3e-47e1-a013-b31d04eb924e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:38.937134 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bfde5b4d-bf3e-47e1-a013-b31d04eb924e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:38.937581 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bfde5b4d-bf3e-47e1-a013-b31d04eb924e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:39.014024 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-580be676-44a4-4266-879b-a72c22870e70 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:39.021682 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-580be676-44a4-4266-879b-a72c22870e70 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1265 microversion: 2.1 time: 0.103653 May 26 12:33:39.022252 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 90/192] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:38 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1265 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:39.080728 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-bfde5b4d-bf3e-47e1-a013-b31d04eb924e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:39.088089 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-bfde5b4d-bf3e-47e1-a013-b31d04eb924e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.163182 May 26 12:33:39.088650 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 103/193] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:38 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:39.103103 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-9dd2eb58-912e-4f48-989e-ed59f010496d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:39.103705 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-9dd2eb58-912e-4f48-989e-ed59f010496d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:39.109722 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9dd2eb58-912e-4f48-989e-ed59f010496d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:39.110174 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9dd2eb58-912e-4f48-989e-ed59f010496d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:39.110941 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9dd2eb58-912e-4f48-989e-ed59f010496d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:39.111382 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9dd2eb58-912e-4f48-989e-ed59f010496d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:39.240776 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-9dd2eb58-912e-4f48-989e-ed59f010496d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:39.249380 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-9dd2eb58-912e-4f48-989e-ed59f010496d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:39.250916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-9dd2eb58-912e-4f48-989e-ed59f010496d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:39.252025 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-9dd2eb58-912e-4f48-989e-ed59f010496d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.152797 May 26 12:33:39.252585 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 91/194] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:39 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:39.757988 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ab49deba-5064-45be-b824-7c223d7d39e2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:39.758592 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ab49deba-5064-45be-b824-7c223d7d39e2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:39.765260 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ab49deba-5064-45be-b824-7c223d7d39e2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:39.765703 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ab49deba-5064-45be-b824-7c223d7d39e2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:39.766449 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ab49deba-5064-45be-b824-7c223d7d39e2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:39.766883 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ab49deba-5064-45be-b824-7c223d7d39e2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:39.897597 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ab49deba-5064-45be-b824-7c223d7d39e2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:39.905960 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ab49deba-5064-45be-b824-7c223d7d39e2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.151737 May 26 12:33:39.906518 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 104/195] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:39 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:40.037793 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-a73a0593-10b0-4796-8e87-765f08b727cc tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:40.038313 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-a73a0593-10b0-4796-8e87-765f08b727cc tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:40.044962 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a73a0593-10b0-4796-8e87-765f08b727cc tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:40.045413 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a73a0593-10b0-4796-8e87-765f08b727cc tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:40.046182 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a73a0593-10b0-4796-8e87-765f08b727cc tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:40.046624 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a73a0593-10b0-4796-8e87-765f08b727cc tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:40.104891 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-70828ff4-80a8-4c39-a8da-ad6bbf28edf7 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:40.105325 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-70828ff4-80a8-4c39-a8da-ad6bbf28edf7 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:40.107377 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a73a0593-10b0-4796-8e87-765f08b727cc tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:40.111515 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-70828ff4-80a8-4c39-a8da-ad6bbf28edf7 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:40.111971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-70828ff4-80a8-4c39-a8da-ad6bbf28edf7 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:40.112825 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-70828ff4-80a8-4c39-a8da-ad6bbf28edf7 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:40.113299 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-70828ff4-80a8-4c39-a8da-ad6bbf28edf7 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:40.114797 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-a73a0593-10b0-4796-8e87-765f08b727cc tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1265 microversion: 2.1 time: 0.081009 May 26 12:33:40.115542 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 92/196] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:40 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1265 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:40.249401 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-70828ff4-80a8-4c39-a8da-ad6bbf28edf7 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:40.260899 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-70828ff4-80a8-4c39-a8da-ad6bbf28edf7 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.159729 May 26 12:33:40.261808 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 105/197] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:40 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:40.269893 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-a51a72b9-73d6-426c-af1a-dc0e36e86d88 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:40.270942 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-a51a72b9-73d6-426c-af1a-dc0e36e86d88 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:40.278502 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a51a72b9-73d6-426c-af1a-dc0e36e86d88 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:40.279182 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a51a72b9-73d6-426c-af1a-dc0e36e86d88 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:40.279967 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a51a72b9-73d6-426c-af1a-dc0e36e86d88 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:40.280416 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a51a72b9-73d6-426c-af1a-dc0e36e86d88 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:40.454044 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a51a72b9-73d6-426c-af1a-dc0e36e86d88 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:40.462750 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a51a72b9-73d6-426c-af1a-dc0e36e86d88 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:40.464634 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a51a72b9-73d6-426c-af1a-dc0e36e86d88 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:40.465779 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-a51a72b9-73d6-426c-af1a-dc0e36e86d88 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.199789 May 26 12:33:40.466393 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 93/198] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:40 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:33:40.923536 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e31c5e9e-a447-49fa-894a-c0db9dfd1c66 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:40.924125 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e31c5e9e-a447-49fa-894a-c0db9dfd1c66 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:40.930464 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e31c5e9e-a447-49fa-894a-c0db9dfd1c66 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:40.931752 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e31c5e9e-a447-49fa-894a-c0db9dfd1c66 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:40.932522 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e31c5e9e-a447-49fa-894a-c0db9dfd1c66 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:40.932981 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e31c5e9e-a447-49fa-894a-c0db9dfd1c66 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:41.064478 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e31c5e9e-a447-49fa-894a-c0db9dfd1c66 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:41.066711 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=100 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:41.073113 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e31c5e9e-a447-49fa-894a-c0db9dfd1c66 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.153386 May 26 12:33:41.073704 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 106/199] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:40 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:41.131571 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f2ebace6-87b4-43d3-b71b-1dfbecde6273 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:41.132205 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-f2ebace6-87b4-43d3-b71b-1dfbecde6273 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:41.139049 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f2ebace6-87b4-43d3-b71b-1dfbecde6273 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:41.139500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f2ebace6-87b4-43d3-b71b-1dfbecde6273 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:41.140264 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f2ebace6-87b4-43d3-b71b-1dfbecde6273 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:41.140841 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f2ebace6-87b4-43d3-b71b-1dfbecde6273 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:41.203314 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-f2ebace6-87b4-43d3-b71b-1dfbecde6273 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:41.211515 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-f2ebace6-87b4-43d3-b71b-1dfbecde6273 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1273 microversion: 2.1 time: 0.083988 May 26 12:33:41.212610 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 94/200] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:41 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1273 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:41.278771 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-cca0d588-5dbc-4a49-ad6f-8c6ec7936d89 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:41.279488 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-cca0d588-5dbc-4a49-ad6f-8c6ec7936d89 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:41.286176 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cca0d588-5dbc-4a49-ad6f-8c6ec7936d89 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:41.286897 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cca0d588-5dbc-4a49-ad6f-8c6ec7936d89 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:41.287730 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cca0d588-5dbc-4a49-ad6f-8c6ec7936d89 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:41.288382 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cca0d588-5dbc-4a49-ad6f-8c6ec7936d89 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:41.432742 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-cca0d588-5dbc-4a49-ad6f-8c6ec7936d89 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:41.442144 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-cca0d588-5dbc-4a49-ad6f-8c6ec7936d89 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.167675 May 26 12:33:41.442892 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 107/201] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:41 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:41.484592 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-c487f918-f8c0-42a5-bdf8-650832f77fb6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:41.485230 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-c487f918-f8c0-42a5-bdf8-650832f77fb6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:41.495004 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c487f918-f8c0-42a5-bdf8-650832f77fb6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:41.495867 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c487f918-f8c0-42a5-bdf8-650832f77fb6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:41.496921 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c487f918-f8c0-42a5-bdf8-650832f77fb6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:41.497331 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c487f918-f8c0-42a5-bdf8-650832f77fb6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:41.647607 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c487f918-f8c0-42a5-bdf8-650832f77fb6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:41.656226 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c487f918-f8c0-42a5-bdf8-650832f77fb6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:41.659215 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c487f918-f8c0-42a5-bdf8-650832f77fb6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:41.660378 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-c487f918-f8c0-42a5-bdf8-650832f77fb6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.179582 May 26 12:33:41.661135 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 95/202] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:41 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:42.092246 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-8ba30c06-1339-481b-9b40-8c17d8236201 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:42.092920 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-8ba30c06-1339-481b-9b40-8c17d8236201 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:42.099498 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8ba30c06-1339-481b-9b40-8c17d8236201 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:42.099948 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8ba30c06-1339-481b-9b40-8c17d8236201 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:42.100692 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8ba30c06-1339-481b-9b40-8c17d8236201 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:42.101186 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8ba30c06-1339-481b-9b40-8c17d8236201 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:42.229778 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-86ad137e-8a8e-4818-ba57-9dd4f8e78d10 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:42.230626 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-86ad137e-8a8e-4818-ba57-9dd4f8e78d10 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:42.237455 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-86ad137e-8a8e-4818-ba57-9dd4f8e78d10 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:42.237914 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-86ad137e-8a8e-4818-ba57-9dd4f8e78d10 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:42.238719 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-86ad137e-8a8e-4818-ba57-9dd4f8e78d10 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:42.239159 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-86ad137e-8a8e-4818-ba57-9dd4f8e78d10 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:42.340290 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-86ad137e-8a8e-4818-ba57-9dd4f8e78d10 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:42.347647 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-86ad137e-8a8e-4818-ba57-9dd4f8e78d10 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1283 microversion: 2.1 time: 0.122367 May 26 12:33:42.348211 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 96/203] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:42 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1283 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:42.404513 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-8ba30c06-1339-481b-9b40-8c17d8236201 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:42.412045 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-8ba30c06-1339-481b-9b40-8c17d8236201 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.323865 May 26 12:33:42.412602 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 108/204] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:42 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:42.459613 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-8458a00d-44fa-4720-9275-540076babe8d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:42.460223 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-8458a00d-44fa-4720-9275-540076babe8d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:42.466876 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8458a00d-44fa-4720-9275-540076babe8d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:42.467327 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8458a00d-44fa-4720-9275-540076babe8d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:42.468090 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8458a00d-44fa-4720-9275-540076babe8d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:42.468527 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8458a00d-44fa-4720-9275-540076babe8d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:42.600033 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-8458a00d-44fa-4720-9275-540076babe8d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:42.607414 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-8458a00d-44fa-4720-9275-540076babe8d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.151762 May 26 12:33:42.607974 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 97/205] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:42 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:42.680077 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-6081bb97-0d5d-4ce7-ae9b-014a06525114 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:42.681252 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-6081bb97-0d5d-4ce7-ae9b-014a06525114 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:42.687375 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6081bb97-0d5d-4ce7-ae9b-014a06525114 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:42.687829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6081bb97-0d5d-4ce7-ae9b-014a06525114 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:42.688594 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6081bb97-0d5d-4ce7-ae9b-014a06525114 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:42.689063 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6081bb97-0d5d-4ce7-ae9b-014a06525114 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:42.816591 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-6081bb97-0d5d-4ce7-ae9b-014a06525114 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:42.825007 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-6081bb97-0d5d-4ce7-ae9b-014a06525114 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:42.826501 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-6081bb97-0d5d-4ce7-ae9b-014a06525114 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:42.827583 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-6081bb97-0d5d-4ce7-ae9b-014a06525114 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.151502 May 26 12:33:42.828134 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 109/206] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:42 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:43.364785 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b8f0cf2c-7ea2-483f-828b-19648cb420fa tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:43.365316 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b8f0cf2c-7ea2-483f-828b-19648cb420fa tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:43.372338 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b8f0cf2c-7ea2-483f-828b-19648cb420fa tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:43.372810 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b8f0cf2c-7ea2-483f-828b-19648cb420fa tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:43.373560 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b8f0cf2c-7ea2-483f-828b-19648cb420fa tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:43.373992 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b8f0cf2c-7ea2-483f-828b-19648cb420fa tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:43.429324 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-845c4671-de04-42be-bea3-4dc6ea519ee5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:43.430100 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-845c4671-de04-42be-bea3-4dc6ea519ee5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:43.436859 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b8f0cf2c-7ea2-483f-828b-19648cb420fa tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:43.437451 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-845c4671-de04-42be-bea3-4dc6ea519ee5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:43.437942 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-845c4671-de04-42be-bea3-4dc6ea519ee5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:43.438798 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-845c4671-de04-42be-bea3-4dc6ea519ee5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:43.439287 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-845c4671-de04-42be-bea3-4dc6ea519ee5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:43.445376 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b8f0cf2c-7ea2-483f-828b-19648cb420fa tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1283 microversion: 2.1 time: 0.084574 May 26 12:33:43.445935 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 98/207] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:43 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1283 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:43.570515 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-845c4671-de04-42be-bea3-4dc6ea519ee5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:43.579074 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-845c4671-de04-42be-bea3-4dc6ea519ee5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.153827 May 26 12:33:43.579864 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 110/208] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:43 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:43.624006 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f7972b03-5fe3-417f-a608-3b30144cadc1 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:43.624536 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-f7972b03-5fe3-417f-a608-3b30144cadc1 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:43.630497 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f7972b03-5fe3-417f-a608-3b30144cadc1 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:43.630939 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f7972b03-5fe3-417f-a608-3b30144cadc1 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:43.631681 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f7972b03-5fe3-417f-a608-3b30144cadc1 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:43.632111 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f7972b03-5fe3-417f-a608-3b30144cadc1 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:43.765417 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-f7972b03-5fe3-417f-a608-3b30144cadc1 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:43.772753 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-f7972b03-5fe3-417f-a608-3b30144cadc1 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.152637 May 26 12:33:43.773303 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 99/209] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:43 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:43.845389 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ca8e1cf8-a47a-4f28-b9b1-2e41abc2534c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:43.845996 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ca8e1cf8-a47a-4f28-b9b1-2e41abc2534c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:43.851933 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ca8e1cf8-a47a-4f28-b9b1-2e41abc2534c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:43.852383 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ca8e1cf8-a47a-4f28-b9b1-2e41abc2534c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:43.853422 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ca8e1cf8-a47a-4f28-b9b1-2e41abc2534c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:43.853863 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ca8e1cf8-a47a-4f28-b9b1-2e41abc2534c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:43.984880 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ca8e1cf8-a47a-4f28-b9b1-2e41abc2534c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:43.992696 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ca8e1cf8-a47a-4f28-b9b1-2e41abc2534c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:43.994224 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ca8e1cf8-a47a-4f28-b9b1-2e41abc2534c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:43.995309 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ca8e1cf8-a47a-4f28-b9b1-2e41abc2534c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.153851 May 26 12:33:43.995855 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 111/210] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:43 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:44.462618 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-615a65f4-7ef7-46f1-a871-56dada27b85d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:44.463225 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-615a65f4-7ef7-46f1-a871-56dada27b85d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:44.469895 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-615a65f4-7ef7-46f1-a871-56dada27b85d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:44.470343 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-615a65f4-7ef7-46f1-a871-56dada27b85d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:44.471103 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-615a65f4-7ef7-46f1-a871-56dada27b85d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:44.471548 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-615a65f4-7ef7-46f1-a871-56dada27b85d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:44.532111 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-615a65f4-7ef7-46f1-a871-56dada27b85d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:44.539392 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-615a65f4-7ef7-46f1-a871-56dada27b85d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1283 microversion: 2.1 time: 0.080670 May 26 12:33:44.540431 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 100/211] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:44 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1283 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:44.596133 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-0a29ca9a-65c2-41b9-a3b9-e854aa21a6a6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:44.596756 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-0a29ca9a-65c2-41b9-a3b9-e854aa21a6a6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:44.602891 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0a29ca9a-65c2-41b9-a3b9-e854aa21a6a6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:44.603493 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0a29ca9a-65c2-41b9-a3b9-e854aa21a6a6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:44.604250 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0a29ca9a-65c2-41b9-a3b9-e854aa21a6a6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:44.604688 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0a29ca9a-65c2-41b9-a3b9-e854aa21a6a6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:44.734165 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-0a29ca9a-65c2-41b9-a3b9-e854aa21a6a6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:44.741512 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-0a29ca9a-65c2-41b9-a3b9-e854aa21a6a6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.149223 May 26 12:33:44.742074 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 112/212] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:44 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:44.789688 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-411fe5ba-43cd-4560-9414-3790d1c5765b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:44.790637 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-411fe5ba-43cd-4560-9414-3790d1c5765b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:44.796561 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-411fe5ba-43cd-4560-9414-3790d1c5765b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:44.797048 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-411fe5ba-43cd-4560-9414-3790d1c5765b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:44.797813 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-411fe5ba-43cd-4560-9414-3790d1c5765b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:44.798255 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-411fe5ba-43cd-4560-9414-3790d1c5765b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:44.927321 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-411fe5ba-43cd-4560-9414-3790d1c5765b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:44.934851 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-411fe5ba-43cd-4560-9414-3790d1c5765b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.148953 May 26 12:33:44.935410 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 101/213] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:44 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:45.013132 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-0c1c5959-6a37-4160-b332-ba2e6dbe2661 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:45.013730 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-0c1c5959-6a37-4160-b332-ba2e6dbe2661 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:45.019606 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0c1c5959-6a37-4160-b332-ba2e6dbe2661 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:45.020052 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0c1c5959-6a37-4160-b332-ba2e6dbe2661 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:45.020830 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0c1c5959-6a37-4160-b332-ba2e6dbe2661 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:45.021539 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0c1c5959-6a37-4160-b332-ba2e6dbe2661 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:45.147623 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-0c1c5959-6a37-4160-b332-ba2e6dbe2661 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:45.156056 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-0c1c5959-6a37-4160-b332-ba2e6dbe2661 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:45.157614 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-0c1c5959-6a37-4160-b332-ba2e6dbe2661 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:45.158707 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-0c1c5959-6a37-4160-b332-ba2e6dbe2661 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.149746 May 26 12:33:45.159258 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 113/214] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:45 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:45.556763 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-549f88da-4e76-4ef8-bcb0-30bb5f99a640 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:45.557363 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-549f88da-4e76-4ef8-bcb0-30bb5f99a640 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:45.563865 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-549f88da-4e76-4ef8-bcb0-30bb5f99a640 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:45.564301 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-549f88da-4e76-4ef8-bcb0-30bb5f99a640 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:45.565071 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-549f88da-4e76-4ef8-bcb0-30bb5f99a640 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:45.565503 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-549f88da-4e76-4ef8-bcb0-30bb5f99a640 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:45.580395 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=100 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:45.626327 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-549f88da-4e76-4ef8-bcb0-30bb5f99a640 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:45.633722 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-549f88da-4e76-4ef8-bcb0-30bb5f99a640 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1283 microversion: 2.1 time: 0.080821 May 26 12:33:45.634769 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 102/215] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:45 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1283 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:45.758407 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-1d1d40c4-64b5-49f0-8bc1-7dc35a78f9d5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:45.759812 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-1d1d40c4-64b5-49f0-8bc1-7dc35a78f9d5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:45.761522 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=100 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:45.767041 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1d1d40c4-64b5-49f0-8bc1-7dc35a78f9d5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:45.767488 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1d1d40c4-64b5-49f0-8bc1-7dc35a78f9d5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:45.768248 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1d1d40c4-64b5-49f0-8bc1-7dc35a78f9d5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:45.768687 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1d1d40c4-64b5-49f0-8bc1-7dc35a78f9d5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:45.897578 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-1d1d40c4-64b5-49f0-8bc1-7dc35a78f9d5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:45.904890 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-1d1d40c4-64b5-49f0-8bc1-7dc35a78f9d5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1364 microversion: 2.1 time: 0.150343 May 26 12:33:45.905449 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 114/216] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:45 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:45.951944 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-17ac1fad-a2b0-4d61-b008-acb9665e976a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:45.952546 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-17ac1fad-a2b0-4d61-b008-acb9665e976a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:45.958507 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-17ac1fad-a2b0-4d61-b008-acb9665e976a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:45.958951 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-17ac1fad-a2b0-4d61-b008-acb9665e976a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:45.959724 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-17ac1fad-a2b0-4d61-b008-acb9665e976a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:45.960163 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-17ac1fad-a2b0-4d61-b008-acb9665e976a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:46.092478 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-17ac1fad-a2b0-4d61-b008-acb9665e976a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:46.099765 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-17ac1fad-a2b0-4d61-b008-acb9665e976a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.151598 May 26 12:33:46.100320 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 103/217] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:45 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:46.177269 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-bc797d0a-6ee1-424b-984a-f4d00fbf5b0c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:46.177876 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-bc797d0a-6ee1-424b-984a-f4d00fbf5b0c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:46.184432 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bc797d0a-6ee1-424b-984a-f4d00fbf5b0c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:46.184910 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bc797d0a-6ee1-424b-984a-f4d00fbf5b0c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:46.185667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bc797d0a-6ee1-424b-984a-f4d00fbf5b0c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:46.186102 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bc797d0a-6ee1-424b-984a-f4d00fbf5b0c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:46.317610 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-bc797d0a-6ee1-424b-984a-f4d00fbf5b0c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:46.325932 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-bc797d0a-6ee1-424b-984a-f4d00fbf5b0c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:46.327384 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-bc797d0a-6ee1-424b-984a-f4d00fbf5b0c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:46.328470 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-bc797d0a-6ee1-424b-984a-f4d00fbf5b0c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.155194 May 26 12:33:46.329054 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 115/218] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:46 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:46.652038 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-44161618-6da2-46b1-b22e-3cc94a95bc1e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:46.652555 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-44161618-6da2-46b1-b22e-3cc94a95bc1e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:46.659004 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-44161618-6da2-46b1-b22e-3cc94a95bc1e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:46.659447 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-44161618-6da2-46b1-b22e-3cc94a95bc1e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:46.660199 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-44161618-6da2-46b1-b22e-3cc94a95bc1e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:46.660657 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-44161618-6da2-46b1-b22e-3cc94a95bc1e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:46.722957 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-44161618-6da2-46b1-b22e-3cc94a95bc1e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:46.731236 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-44161618-6da2-46b1-b22e-3cc94a95bc1e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1283 microversion: 2.1 time: 0.083802 May 26 12:33:46.731805 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 104/219] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:46 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1283 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:46.921310 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-6998d248-bee3-4591-b391-8118c7f46823 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:46.921844 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-6998d248-bee3-4591-b391-8118c7f46823 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:46.927846 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6998d248-bee3-4591-b391-8118c7f46823 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:46.928289 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6998d248-bee3-4591-b391-8118c7f46823 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:46.929070 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6998d248-bee3-4591-b391-8118c7f46823 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:46.929505 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6998d248-bee3-4591-b391-8118c7f46823 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:47.069753 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-6998d248-bee3-4591-b391-8118c7f46823 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:47.082088 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-6998d248-bee3-4591-b391-8118c7f46823 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1555 microversion: 2.1 time: 0.164613 May 26 12:33:47.082689 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 116/220] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:46 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:47.099999 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-11ac959f-0d14-4331-9127-439c59b20b5d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:47.100856 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-11ac959f-0d14-4331-9127-439c59b20b5d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:47.107075 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-11ac959f-0d14-4331-9127-439c59b20b5d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:47.107730 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-11ac959f-0d14-4331-9127-439c59b20b5d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:47.108670 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-11ac959f-0d14-4331-9127-439c59b20b5d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:47.109308 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-11ac959f-0d14-4331-9127-439c59b20b5d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:47.116960 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-b87fbdc8-a738-4f6b-90f0-deefb9764d69 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:47.118674 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-b87fbdc8-a738-4f6b-90f0-deefb9764d69 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:47.131738 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b87fbdc8-a738-4f6b-90f0-deefb9764d69 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:47.132373 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b87fbdc8-a738-4f6b-90f0-deefb9764d69 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:47.133226 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b87fbdc8-a738-4f6b-90f0-deefb9764d69 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:47.133890 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b87fbdc8-a738-4f6b-90f0-deefb9764d69 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:47.308425 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-11ac959f-0d14-4331-9127-439c59b20b5d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.212437 May 26 12:33:47.309083 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 105/221] 10.222.0.39 () {58 vars in 1274 bytes} [Thu May 26 12:33:47 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038/os-interface => generated 285 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:33:47.346290 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-ce67da20-ee19-4b25-b92e-511dd6710471 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:47.346891 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-ce67da20-ee19-4b25-b92e-511dd6710471 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:47.353955 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ce67da20-ee19-4b25-b92e-511dd6710471 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:47.354406 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ce67da20-ee19-4b25-b92e-511dd6710471 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:47.355157 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ce67da20-ee19-4b25-b92e-511dd6710471 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:47.355592 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ce67da20-ee19-4b25-b92e-511dd6710471 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:47.851531 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-b87fbdc8-a738-4f6b-90f0-deefb9764d69 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:47.860664 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-b87fbdc8-a738-4f6b-90f0-deefb9764d69 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.747605 May 26 12:33:47.867828 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 117/222] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:47 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:47.867828 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-5a07a547-a8c6-4771-aa79-00be4684e208 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:47.870245 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-5a07a547-a8c6-4771-aa79-00be4684e208 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:47.877662 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5a07a547-a8c6-4771-aa79-00be4684e208 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:47.877662 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5a07a547-a8c6-4771-aa79-00be4684e208 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:47.881244 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5a07a547-a8c6-4771-aa79-00be4684e208 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:47.881244 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5a07a547-a8c6-4771-aa79-00be4684e208 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:48.031972 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-5a07a547-a8c6-4771-aa79-00be4684e208 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:48.042101 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ce67da20-ee19-4b25-b92e-511dd6710471 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:48.044884 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-5a07a547-a8c6-4771-aa79-00be4684e208 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1271 microversion: 2.1 time: 0.181724 May 26 12:33:48.045825 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 118/223] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:47 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1271 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:48.060335 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ce67da20-ee19-4b25-b92e-511dd6710471 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:48.061982 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ce67da20-ee19-4b25-b92e-511dd6710471 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:48.063008 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-ce67da20-ee19-4b25-b92e-511dd6710471 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.720591 May 26 12:33:48.063720 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 106/224] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:47 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:33:48.880933 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-7be1475e-2fb8-49f6-a504-573141958ef4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:48.881696 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-7be1475e-2fb8-49f6-a504-573141958ef4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:48.890303 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7be1475e-2fb8-49f6-a504-573141958ef4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:48.890720 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7be1475e-2fb8-49f6-a504-573141958ef4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:48.891733 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7be1475e-2fb8-49f6-a504-573141958ef4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:48.892105 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7be1475e-2fb8-49f6-a504-573141958ef4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:49.062914 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-5c4bafa3-6a01-4912-96f5-52c15a47b121 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:49.063638 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-5c4bafa3-6a01-4912-96f5-52c15a47b121 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:49.070225 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5c4bafa3-6a01-4912-96f5-52c15a47b121 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:49.070751 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5c4bafa3-6a01-4912-96f5-52c15a47b121 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:49.071616 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5c4bafa3-6a01-4912-96f5-52c15a47b121 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:49.072309 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5c4bafa3-6a01-4912-96f5-52c15a47b121 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:49.107877 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-7be1475e-2fb8-49f6-a504-573141958ef4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:49.116154 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-7be1475e-2fb8-49f6-a504-573141958ef4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.239636 May 26 12:33:49.125274 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 119/225] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:48 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:49.131011 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-56d20534-189e-4498-92b8-f7d42d89b520 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:49.131625 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-56d20534-189e-4498-92b8-f7d42d89b520 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:49.138971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-56d20534-189e-4498-92b8-f7d42d89b520 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:49.139424 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-56d20534-189e-4498-92b8-f7d42d89b520 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:49.140429 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-56d20534-189e-4498-92b8-f7d42d89b520 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:49.140682 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-56d20534-189e-4498-92b8-f7d42d89b520 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:49.537838 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-5c4bafa3-6a01-4912-96f5-52c15a47b121 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:49.546223 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-5c4bafa3-6a01-4912-96f5-52c15a47b121 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.487280 May 26 12:33:49.546920 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 107/226] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:49 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:49.603889 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-56d20534-189e-4498-92b8-f7d42d89b520 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:49.613552 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-56d20534-189e-4498-92b8-f7d42d89b520 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:49.615079 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-56d20534-189e-4498-92b8-f7d42d89b520 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:49.616521 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-56d20534-189e-4498-92b8-f7d42d89b520 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.489545 May 26 12:33:49.617125 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 120/227] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:49 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:49.701570 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-877b65a1-69c5-4f52-ab78-d427bdd593bb req-ebc07bf8-c37a-4e4c-a183-aa6de1f0f6ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cfc21dd-efee-45cb-9462-cdd0025a5038", "tag": "c4a31d7d-0831-4fea-a609-85371a2084a6"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:33:49.710522 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-877b65a1-69c5-4f52-ab78-d427bdd593bb req-ebc07bf8-c37a-4e4c-a183-aa6de1f0f6ed service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:49.710971 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-877b65a1-69c5-4f52-ab78-d427bdd593bb req-ebc07bf8-c37a-4e4c-a183-aa6de1f0f6ed service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:49.723389 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-877b65a1-69c5-4f52-ab78-d427bdd593bb req-ebc07bf8-c37a-4e4c-a183-aa6de1f0f6ed service nova] Creating event network-changed:c4a31d7d-0831-4fea-a609-85371a2084a6 for instance 1cfc21dd-efee-45cb-9462-cdd0025a5038 on hv-cinder-81514 May 26 12:33:49.729235 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-877b65a1-69c5-4f52-ab78-d427bdd593bb req-ebc07bf8-c37a-4e4c-a183-aa6de1f0f6ed service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031410 May 26 12:33:49.729837 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 108/228] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:33:50.134766 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-4785808e-93e8-4e72-812d-c340c02e099d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:50.135484 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-4785808e-93e8-4e72-812d-c340c02e099d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:50.146523 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4785808e-93e8-4e72-812d-c340c02e099d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:50.146523 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4785808e-93e8-4e72-812d-c340c02e099d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:50.146523 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4785808e-93e8-4e72-812d-c340c02e099d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:50.146523 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4785808e-93e8-4e72-812d-c340c02e099d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:50.297700 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-4785808e-93e8-4e72-812d-c340c02e099d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:50.306731 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-4785808e-93e8-4e72-812d-c340c02e099d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.175179 May 26 12:33:50.307659 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 121/229] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:50 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:50.564455 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-2a466b06-3150-420e-9b28-2bb599b593d6 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:50.565185 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-2a466b06-3150-420e-9b28-2bb599b593d6 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:50.572007 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2a466b06-3150-420e-9b28-2bb599b593d6 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:50.572513 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2a466b06-3150-420e-9b28-2bb599b593d6 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:50.573322 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2a466b06-3150-420e-9b28-2bb599b593d6 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:50.573793 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2a466b06-3150-420e-9b28-2bb599b593d6 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:50.635554 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-07544c07-d163-45f8-af63-55a497974ba8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:50.636602 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-07544c07-d163-45f8-af63-55a497974ba8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:50.643362 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-07544c07-d163-45f8-af63-55a497974ba8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:50.643819 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-07544c07-d163-45f8-af63-55a497974ba8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:50.644612 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-07544c07-d163-45f8-af63-55a497974ba8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:50.645079 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-07544c07-d163-45f8-af63-55a497974ba8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:50.755703 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2a466b06-3150-420e-9b28-2bb599b593d6 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:50.764235 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-2a466b06-3150-420e-9b28-2bb599b593d6 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.204348 May 26 12:33:50.765178 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 109/230] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:50 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:50.800572 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-07544c07-d163-45f8-af63-55a497974ba8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:50.809734 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-07544c07-d163-45f8-af63-55a497974ba8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:50.811267 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-07544c07-d163-45f8-af63-55a497974ba8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:50.812376 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-07544c07-d163-45f8-af63-55a497974ba8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.181759 May 26 12:33:50.812970 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 122/231] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:50 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:51.325316 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-989024ec-0e4d-4675-9e3b-8e0b65632597 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:51.326010 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-989024ec-0e4d-4675-9e3b-8e0b65632597 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:51.328049 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=90 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:51.334180 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-989024ec-0e4d-4675-9e3b-8e0b65632597 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:51.334703 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-989024ec-0e4d-4675-9e3b-8e0b65632597 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:51.335507 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-989024ec-0e4d-4675-9e3b-8e0b65632597 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:51.335943 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-989024ec-0e4d-4675-9e3b-8e0b65632597 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:51.463340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-989024ec-0e4d-4675-9e3b-8e0b65632597 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:51.470880 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-989024ec-0e4d-4675-9e3b-8e0b65632597 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.150955 May 26 12:33:51.471450 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 110/232] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:51 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:51.781572 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-81784c42-2724-4bea-a575-b42678041c0d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:51.782095 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-81784c42-2724-4bea-a575-b42678041c0d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:51.788040 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-81784c42-2724-4bea-a575-b42678041c0d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:51.788480 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-81784c42-2724-4bea-a575-b42678041c0d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:51.789259 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-81784c42-2724-4bea-a575-b42678041c0d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:51.790449 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-81784c42-2724-4bea-a575-b42678041c0d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:51.805122 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=100 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:51.830244 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-73bc66e3-9fc9-43b1-9455-c0cf6ec5d2fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:51.830845 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-73bc66e3-9fc9-43b1-9455-c0cf6ec5d2fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:51.837837 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-73bc66e3-9fc9-43b1-9455-c0cf6ec5d2fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:51.838265 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-73bc66e3-9fc9-43b1-9455-c0cf6ec5d2fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:51.839080 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-73bc66e3-9fc9-43b1-9455-c0cf6ec5d2fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:51.839518 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-73bc66e3-9fc9-43b1-9455-c0cf6ec5d2fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:51.972835 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-81784c42-2724-4bea-a575-b42678041c0d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:51.981186 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-81784c42-2724-4bea-a575-b42678041c0d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.203492 May 26 12:33:51.981943 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 123/233] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:51 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:51.999949 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-73bc66e3-9fc9-43b1-9455-c0cf6ec5d2fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:52.007727 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-73bc66e3-9fc9-43b1-9455-c0cf6ec5d2fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:52.010361 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-73bc66e3-9fc9-43b1-9455-c0cf6ec5d2fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:52.011456 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-73bc66e3-9fc9-43b1-9455-c0cf6ec5d2fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.185231 May 26 12:33:52.012008 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 111/234] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:51 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:33:52.487927 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d22908b5-3f07-4569-80f1-d2aabfa348ef tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:52.488850 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d22908b5-3f07-4569-80f1-d2aabfa348ef tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:52.496110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d22908b5-3f07-4569-80f1-d2aabfa348ef tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:52.496560 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d22908b5-3f07-4569-80f1-d2aabfa348ef tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:52.497426 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d22908b5-3f07-4569-80f1-d2aabfa348ef tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:52.497973 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d22908b5-3f07-4569-80f1-d2aabfa348ef tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:52.637046 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d22908b5-3f07-4569-80f1-d2aabfa348ef tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:52.644566 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-d22908b5-3f07-4569-80f1-d2aabfa348ef tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.161032 May 26 12:33:52.645153 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 124/235] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:52 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:52.998623 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-43257c6a-75db-43ad-a624-a52bb14787b6 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:52.999161 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-43257c6a-75db-43ad-a624-a52bb14787b6 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:53.005727 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-43257c6a-75db-43ad-a624-a52bb14787b6 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:53.006169 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-43257c6a-75db-43ad-a624-a52bb14787b6 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:53.006916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-43257c6a-75db-43ad-a624-a52bb14787b6 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:53.007347 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-43257c6a-75db-43ad-a624-a52bb14787b6 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:53.029654 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-4b42c173-ba7a-4a2b-8fb8-0ce5b40337cb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:53.030436 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-4b42c173-ba7a-4a2b-8fb8-0ce5b40337cb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:53.036874 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4b42c173-ba7a-4a2b-8fb8-0ce5b40337cb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:53.036874 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4b42c173-ba7a-4a2b-8fb8-0ce5b40337cb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:53.037634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4b42c173-ba7a-4a2b-8fb8-0ce5b40337cb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:53.038068 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4b42c173-ba7a-4a2b-8fb8-0ce5b40337cb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:53.208150 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-43257c6a-75db-43ad-a624-a52bb14787b6 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:53.213252 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-4b42c173-ba7a-4a2b-8fb8-0ce5b40337cb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:53.217893 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-43257c6a-75db-43ad-a624-a52bb14787b6 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.223103 May 26 12:33:53.218755 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 112/236] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:52 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:53.222158 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-4b42c173-ba7a-4a2b-8fb8-0ce5b40337cb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:53.223718 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-4b42c173-ba7a-4a2b-8fb8-0ce5b40337cb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:53.224835 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-4b42c173-ba7a-4a2b-8fb8-0ce5b40337cb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.199070 May 26 12:33:53.225375 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 125/237] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:53 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:33:53.663194 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-65ac7d46-9896-43ab-be3a-1c468b6b615d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:53.663890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-65ac7d46-9896-43ab-be3a-1c468b6b615d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:53.671194 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-65ac7d46-9896-43ab-be3a-1c468b6b615d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:53.671735 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-65ac7d46-9896-43ab-be3a-1c468b6b615d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:53.672551 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-65ac7d46-9896-43ab-be3a-1c468b6b615d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:53.673133 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-65ac7d46-9896-43ab-be3a-1c468b6b615d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:53.880886 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-65ac7d46-9896-43ab-be3a-1c468b6b615d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:53.888884 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-65ac7d46-9896-43ab-be3a-1c468b6b615d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.230437 May 26 12:33:53.889464 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 113/238] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:53 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:54.208188 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-842b7804-151b-40aa-8bbe-9a0fdb0d302b req-97df2aba-600a-438b-b7cc-6f72965fdb75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7537224-8613-46e8-87db-0b559643c4a8", "tag": "dce540cd-4f61-4a97-acbe-502a1728d37c"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:33:54.217239 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-842b7804-151b-40aa-8bbe-9a0fdb0d302b req-97df2aba-600a-438b-b7cc-6f72965fdb75 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:54.217683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-842b7804-151b-40aa-8bbe-9a0fdb0d302b req-97df2aba-600a-438b-b7cc-6f72965fdb75 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:54.229976 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-842b7804-151b-40aa-8bbe-9a0fdb0d302b req-97df2aba-600a-438b-b7cc-6f72965fdb75 service nova] Creating event network-changed:dce540cd-4f61-4a97-acbe-502a1728d37c for instance c7537224-8613-46e8-87db-0b559643c4a8 on hv-cinder-81514 May 26 12:33:54.234958 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-842b7804-151b-40aa-8bbe-9a0fdb0d302b req-97df2aba-600a-438b-b7cc-6f72965fdb75 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030397 May 26 12:33:54.235261 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-479f3a18-2727-44fc-a3cb-37a72d709066 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:54.235714 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 126/239] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:33:54.235876 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-479f3a18-2727-44fc-a3cb-37a72d709066 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:54.242630 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-479f3a18-2727-44fc-a3cb-37a72d709066 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:54.244353 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-093cf8a0-f708-487e-97a8-5096594dd3ee tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:54.245068 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-093cf8a0-f708-487e-97a8-5096594dd3ee tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:54.249201 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-479f3a18-2727-44fc-a3cb-37a72d709066 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:54.250015 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-479f3a18-2727-44fc-a3cb-37a72d709066 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:54.250464 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-479f3a18-2727-44fc-a3cb-37a72d709066 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:54.251221 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-093cf8a0-f708-487e-97a8-5096594dd3ee tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:54.251665 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-093cf8a0-f708-487e-97a8-5096594dd3ee tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:54.252417 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-093cf8a0-f708-487e-97a8-5096594dd3ee tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:54.252876 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-093cf8a0-f708-487e-97a8-5096594dd3ee tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:54.472533 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-093cf8a0-f708-487e-97a8-5096594dd3ee tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:54.476376 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-479f3a18-2727-44fc-a3cb-37a72d709066 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:54.482140 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-093cf8a0-f708-487e-97a8-5096594dd3ee tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:54.483751 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-093cf8a0-f708-487e-97a8-5096594dd3ee tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:54.484388 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-479f3a18-2727-44fc-a3cb-37a72d709066 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.252944 May 26 12:33:54.484999 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 114/240] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:54 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:33:54.485133 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-093cf8a0-f708-487e-97a8-5096594dd3ee tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.245193 May 26 12:33:54.492772 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 127/241] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:54 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:54.905605 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-2d5ecaac-f8fa-4eb4-9e7d-a96d732d864b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:54.906137 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-2d5ecaac-f8fa-4eb4-9e7d-a96d732d864b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:54.912026 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2d5ecaac-f8fa-4eb4-9e7d-a96d732d864b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:54.912473 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2d5ecaac-f8fa-4eb4-9e7d-a96d732d864b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:54.913258 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2d5ecaac-f8fa-4eb4-9e7d-a96d732d864b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:54.913698 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2d5ecaac-f8fa-4eb4-9e7d-a96d732d864b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:55.060812 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2d5ecaac-f8fa-4eb4-9e7d-a96d732d864b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:55.069443 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-2d5ecaac-f8fa-4eb4-9e7d-a96d732d864b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.167602 May 26 12:33:55.070004 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 115/242] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:54 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:55.506455 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-1375763d-431d-4674-b956-dd5233a65205 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:55.510075 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ed47d965-41bb-4480-9d43-b86ccf7e872e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:55.510699 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ed47d965-41bb-4480-9d43-b86ccf7e872e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:55.514645 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-1375763d-431d-4674-b956-dd5233a65205 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:55.523227 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1375763d-431d-4674-b956-dd5233a65205 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:55.524233 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1375763d-431d-4674-b956-dd5233a65205 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:55.525286 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1375763d-431d-4674-b956-dd5233a65205 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:55.525738 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1375763d-431d-4674-b956-dd5233a65205 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:55.528885 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ed47d965-41bb-4480-9d43-b86ccf7e872e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:55.529382 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ed47d965-41bb-4480-9d43-b86ccf7e872e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:55.530297 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ed47d965-41bb-4480-9d43-b86ccf7e872e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:55.530677 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ed47d965-41bb-4480-9d43-b86ccf7e872e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:55.735671 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ed47d965-41bb-4480-9d43-b86ccf7e872e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:55.745535 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ed47d965-41bb-4480-9d43-b86ccf7e872e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.247376 May 26 12:33:55.746124 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 128/243] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:55 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:55.786866 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-1375763d-431d-4674-b956-dd5233a65205 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:55.800656 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-1375763d-431d-4674-b956-dd5233a65205 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:55.806807 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-1375763d-431d-4674-b956-dd5233a65205 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:55.808132 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-1375763d-431d-4674-b956-dd5233a65205 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.306306 May 26 12:33:55.808823 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 116/244] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:55 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:33:56.087347 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-5b56e1be-4b8b-470c-83f9-ab92586be642 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:56.088482 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-5b56e1be-4b8b-470c-83f9-ab92586be642 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:56.094522 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5b56e1be-4b8b-470c-83f9-ab92586be642 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:56.095185 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5b56e1be-4b8b-470c-83f9-ab92586be642 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:56.095945 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5b56e1be-4b8b-470c-83f9-ab92586be642 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:56.096384 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5b56e1be-4b8b-470c-83f9-ab92586be642 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:56.259140 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-5b56e1be-4b8b-470c-83f9-ab92586be642 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:56.269056 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-5b56e1be-4b8b-470c-83f9-ab92586be642 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.185050 May 26 12:33:56.269056 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 129/245] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:56 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:56.762313 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-84ae7c78-082d-4118-a368-6e36a8d1c58d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:56.763252 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-84ae7c78-082d-4118-a368-6e36a8d1c58d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:56.770119 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-84ae7c78-082d-4118-a368-6e36a8d1c58d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:56.770567 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-84ae7c78-082d-4118-a368-6e36a8d1c58d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:56.771352 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-84ae7c78-082d-4118-a368-6e36a8d1c58d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:56.771784 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-84ae7c78-082d-4118-a368-6e36a8d1c58d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:56.826617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-867b35cd-19fb-4c95-927b-057fa52fa2a5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:56.827881 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-867b35cd-19fb-4c95-927b-057fa52fa2a5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:56.837086 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-867b35cd-19fb-4c95-927b-057fa52fa2a5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:56.837673 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-867b35cd-19fb-4c95-927b-057fa52fa2a5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:56.838522 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-867b35cd-19fb-4c95-927b-057fa52fa2a5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:56.839042 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-867b35cd-19fb-4c95-927b-057fa52fa2a5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:57.043809 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-84ae7c78-082d-4118-a368-6e36a8d1c58d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:57.052003 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-84ae7c78-082d-4118-a368-6e36a8d1c58d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.294076 May 26 12:33:57.062847 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 117/246] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:56 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:57.064587 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-867b35cd-19fb-4c95-927b-057fa52fa2a5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:57.077660 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-867b35cd-19fb-4c95-927b-057fa52fa2a5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:57.086355 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-867b35cd-19fb-4c95-927b-057fa52fa2a5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:57.088259 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-867b35cd-19fb-4c95-927b-057fa52fa2a5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.264966 May 26 12:33:57.089065 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 130/247] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:56 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:33:57.294065 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-67d561c9-e901-4992-af71-1b5a4e016e81 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:57.294984 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-67d561c9-e901-4992-af71-1b5a4e016e81 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:57.303425 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-67d561c9-e901-4992-af71-1b5a4e016e81 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:57.303888 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-67d561c9-e901-4992-af71-1b5a4e016e81 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:57.304682 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-67d561c9-e901-4992-af71-1b5a4e016e81 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:57.314433 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-67d561c9-e901-4992-af71-1b5a4e016e81 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:57.471248 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-67d561c9-e901-4992-af71-1b5a4e016e81 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:57.479572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-67d561c9-e901-4992-af71-1b5a4e016e81 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.194727 May 26 12:33:57.480228 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 118/248] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:57 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:58.070265 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-0f0852f8-1f7b-49d0-aa75-de7141b3acf2 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:58.071345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-0f0852f8-1f7b-49d0-aa75-de7141b3acf2 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:58.077987 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0f0852f8-1f7b-49d0-aa75-de7141b3acf2 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:58.078437 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0f0852f8-1f7b-49d0-aa75-de7141b3acf2 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:58.079232 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0f0852f8-1f7b-49d0-aa75-de7141b3acf2 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:58.079670 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0f0852f8-1f7b-49d0-aa75-de7141b3acf2 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:58.106566 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-882f9259-fcaf-4254-9874-74ec944d6589 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:58.107727 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-882f9259-fcaf-4254-9874-74ec944d6589 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:58.114365 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-882f9259-fcaf-4254-9874-74ec944d6589 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:58.114788 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-882f9259-fcaf-4254-9874-74ec944d6589 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:58.115558 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-882f9259-fcaf-4254-9874-74ec944d6589 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:58.115999 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-882f9259-fcaf-4254-9874-74ec944d6589 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:58.272580 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-0f0852f8-1f7b-49d0-aa75-de7141b3acf2 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:58.280598 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-0f0852f8-1f7b-49d0-aa75-de7141b3acf2 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.214331 May 26 12:33:58.281466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 131/249] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:58 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:58.313127 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-882f9259-fcaf-4254-9874-74ec944d6589 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:58.322886 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-882f9259-fcaf-4254-9874-74ec944d6589 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:58.324494 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-882f9259-fcaf-4254-9874-74ec944d6589 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:58.325628 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-882f9259-fcaf-4254-9874-74ec944d6589 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.222887 May 26 12:33:58.326168 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 119/250] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:58 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:33:58.497194 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ad99604d-27af-4958-b50b-3eb6ef48c929 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:58.497773 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ad99604d-27af-4958-b50b-3eb6ef48c929 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:58.503641 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ad99604d-27af-4958-b50b-3eb6ef48c929 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:58.504054 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ad99604d-27af-4958-b50b-3eb6ef48c929 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:58.504840 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ad99604d-27af-4958-b50b-3eb6ef48c929 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:58.505272 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ad99604d-27af-4958-b50b-3eb6ef48c929 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:58.647784 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ad99604d-27af-4958-b50b-3eb6ef48c929 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:58.655609 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ad99604d-27af-4958-b50b-3eb6ef48c929 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.162228 May 26 12:33:58.656204 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 132/251] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:58 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:59.298087 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-1a9ed8b2-fe27-4cdf-b418-8fd3175535ec tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:59.298719 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-1a9ed8b2-fe27-4cdf-b418-8fd3175535ec tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:59.305384 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1a9ed8b2-fe27-4cdf-b418-8fd3175535ec tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:59.305805 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1a9ed8b2-fe27-4cdf-b418-8fd3175535ec tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:59.306553 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1a9ed8b2-fe27-4cdf-b418-8fd3175535ec tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:59.306993 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1a9ed8b2-fe27-4cdf-b418-8fd3175535ec tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:59.311148 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=100 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:59.343005 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e66db8e1-8f30-4f36-8fac-4f4d5f81cd9a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:59.343818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e66db8e1-8f30-4f36-8fac-4f4d5f81cd9a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:59.351270 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e66db8e1-8f30-4f36-8fac-4f4d5f81cd9a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:59.351699 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e66db8e1-8f30-4f36-8fac-4f4d5f81cd9a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:59.352565 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e66db8e1-8f30-4f36-8fac-4f4d5f81cd9a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:59.353090 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e66db8e1-8f30-4f36-8fac-4f4d5f81cd9a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:59.517408 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-1a9ed8b2-fe27-4cdf-b418-8fd3175535ec tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:59.526921 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-1a9ed8b2-fe27-4cdf-b418-8fd3175535ec tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.232537 May 26 12:33:59.527597 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 120/252] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:59 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:33:59.544053 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e66db8e1-8f30-4f36-8fac-4f4d5f81cd9a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:59.556829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e66db8e1-8f30-4f36-8fac-4f4d5f81cd9a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:59.558349 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e66db8e1-8f30-4f36-8fac-4f4d5f81cd9a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:59.559485 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e66db8e1-8f30-4f36-8fac-4f4d5f81cd9a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.220375 May 26 12:33:59.560060 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 133/253] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:33:59 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:33:59.673107 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-694d6f20-f389-4706-a0c5-0ce6279789a2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:33:59.673516 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-694d6f20-f389-4706-a0c5-0ce6279789a2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:33:59.679987 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-694d6f20-f389-4706-a0c5-0ce6279789a2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:59.680436 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-694d6f20-f389-4706-a0c5-0ce6279789a2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:59.681326 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-694d6f20-f389-4706-a0c5-0ce6279789a2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:33:59.681764 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-694d6f20-f389-4706-a0c5-0ce6279789a2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:33:59.820125 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-694d6f20-f389-4706-a0c5-0ce6279789a2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:33:59.828334 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-694d6f20-f389-4706-a0c5-0ce6279789a2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.159244 May 26 12:33:59.828921 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 121/254] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:33:59 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:00.543743 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-6eb1104f-14b5-4ff3-a59b-e86e7d20f1d3 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:00.544350 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-6eb1104f-14b5-4ff3-a59b-e86e7d20f1d3 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:00.551454 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6eb1104f-14b5-4ff3-a59b-e86e7d20f1d3 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:00.551846 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6eb1104f-14b5-4ff3-a59b-e86e7d20f1d3 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:00.552610 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6eb1104f-14b5-4ff3-a59b-e86e7d20f1d3 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:00.553074 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6eb1104f-14b5-4ff3-a59b-e86e7d20f1d3 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:00.576526 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-5420a64f-0bad-467e-94df-a318df8c9096 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:00.577782 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-5420a64f-0bad-467e-94df-a318df8c9096 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:00.584210 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5420a64f-0bad-467e-94df-a318df8c9096 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:00.584776 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5420a64f-0bad-467e-94df-a318df8c9096 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:00.585748 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5420a64f-0bad-467e-94df-a318df8c9096 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:00.586467 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5420a64f-0bad-467e-94df-a318df8c9096 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:00.770550 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-6eb1104f-14b5-4ff3-a59b-e86e7d20f1d3 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:00.774533 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-5420a64f-0bad-467e-94df-a318df8c9096 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:00.778258 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-6eb1104f-14b5-4ff3-a59b-e86e7d20f1d3 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.238258 May 26 12:34:00.779006 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 134/255] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:00 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:00.782634 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-5420a64f-0bad-467e-94df-a318df8c9096 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:00.784164 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-5420a64f-0bad-467e-94df-a318df8c9096 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:00.785531 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-5420a64f-0bad-467e-94df-a318df8c9096 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.213109 May 26 12:34:00.786006 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 122/256] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:34:00 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:34:00.845020 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-64376221-ddef-434c-a4ad-b3ad9250e215 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:00.845720 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-64376221-ddef-434c-a4ad-b3ad9250e215 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:00.851689 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-64376221-ddef-434c-a4ad-b3ad9250e215 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:00.852142 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-64376221-ddef-434c-a4ad-b3ad9250e215 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:00.852934 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-64376221-ddef-434c-a4ad-b3ad9250e215 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:00.853376 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-64376221-ddef-434c-a4ad-b3ad9250e215 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:00.990091 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-64376221-ddef-434c-a4ad-b3ad9250e215 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:00.998137 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-64376221-ddef-434c-a4ad-b3ad9250e215 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.156902 May 26 12:34:00.998711 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 135/257] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:00 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:01.796834 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-36c74ce5-5a99-4bc3-8a40-27e8d1529a31 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:01.798177 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-36c74ce5-5a99-4bc3-8a40-27e8d1529a31 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:01.804240 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d88573b8-497b-4b57-89cb-60f9a0d41ecf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:01.807584 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d88573b8-497b-4b57-89cb-60f9a0d41ecf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:01.817687 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-36c74ce5-5a99-4bc3-8a40-27e8d1529a31 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:01.819747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d88573b8-497b-4b57-89cb-60f9a0d41ecf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:01.820562 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-36c74ce5-5a99-4bc3-8a40-27e8d1529a31 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:01.821198 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d88573b8-497b-4b57-89cb-60f9a0d41ecf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:01.822202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-36c74ce5-5a99-4bc3-8a40-27e8d1529a31 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:01.822639 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-36c74ce5-5a99-4bc3-8a40-27e8d1529a31 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:01.827744 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d88573b8-497b-4b57-89cb-60f9a0d41ecf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:01.828676 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d88573b8-497b-4b57-89cb-60f9a0d41ecf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:02.072277 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-36c74ce5-5a99-4bc3-8a40-27e8d1529a31 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:02.080299 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-36c74ce5-5a99-4bc3-8a40-27e8d1529a31 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.288258 May 26 12:34:02.088240 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 123/258] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:01 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:02.105595 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-a4f575fd-8321-4550-8b00-36a812abca4f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:02.106214 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-a4f575fd-8321-4550-8b00-36a812abca4f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:02.113132 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a4f575fd-8321-4550-8b00-36a812abca4f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:02.113767 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a4f575fd-8321-4550-8b00-36a812abca4f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:02.114716 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a4f575fd-8321-4550-8b00-36a812abca4f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:02.115310 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a4f575fd-8321-4550-8b00-36a812abca4f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:02.141894 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d88573b8-497b-4b57-89cb-60f9a0d41ecf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:02.152532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d88573b8-497b-4b57-89cb-60f9a0d41ecf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:02.154174 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d88573b8-497b-4b57-89cb-60f9a0d41ecf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:02.155327 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-d88573b8-497b-4b57-89cb-60f9a0d41ecf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1407 microversion: 2.20 time: 0.355912 May 26 12:34:02.155931 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 136/259] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:34:01 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1407 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:34:02.430862 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a4f575fd-8321-4550-8b00-36a812abca4f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:02.438631 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-a4f575fd-8321-4550-8b00-36a812abca4f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.349364 May 26 12:34:02.439466 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 124/260] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:02 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:03.105177 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-7c10ee34-3f9b-44da-9a40-be50c7e2a586 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:03.105810 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-7c10ee34-3f9b-44da-9a40-be50c7e2a586 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:03.111687 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7c10ee34-3f9b-44da-9a40-be50c7e2a586 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:03.112132 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7c10ee34-3f9b-44da-9a40-be50c7e2a586 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:03.112916 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7c10ee34-3f9b-44da-9a40-be50c7e2a586 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:03.113347 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7c10ee34-3f9b-44da-9a40-be50c7e2a586 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:03.176825 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-2e7d384f-1d95-4551-8070-154e782a80b5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:03.178419 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-2e7d384f-1d95-4551-8070-154e782a80b5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:03.185828 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2e7d384f-1d95-4551-8070-154e782a80b5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:03.186277 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2e7d384f-1d95-4551-8070-154e782a80b5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:03.187043 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2e7d384f-1d95-4551-8070-154e782a80b5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:03.187479 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2e7d384f-1d95-4551-8070-154e782a80b5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:03.659328 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-7c10ee34-3f9b-44da-9a40-be50c7e2a586 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:03.669703 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-7c10ee34-3f9b-44da-9a40-be50c7e2a586 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.568565 May 26 12:34:03.670298 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 137/261] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:03 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:03.675260 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-246fd09d-15cf-4efc-b643-7676b4a35395 req-21e15f3f-85ae-4864-b212-be3549f386a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff659e6a-5e2b-45d6-84d5-360c22ccc03e", "name": "network-vif-plugged", "status": "completed", "tag": "ce7102b2-644a-427b-bd62-1d31c3727bcb"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:34:03.684748 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-246fd09d-15cf-4efc-b643-7676b4a35395 req-21e15f3f-85ae-4864-b212-be3549f386a1 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:03.685254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-246fd09d-15cf-4efc-b643-7676b4a35395 req-21e15f3f-85ae-4864-b212-be3549f386a1 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:03.687936 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2e7d384f-1d95-4551-8070-154e782a80b5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:03.698035 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2e7d384f-1d95-4551-8070-154e782a80b5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:03.698597 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-246fd09d-15cf-4efc-b643-7676b4a35395 req-21e15f3f-85ae-4864-b212-be3549f386a1 service nova] Creating event network-vif-plugged:ce7102b2-644a-427b-bd62-1d31c3727bcb for instance ff659e6a-5e2b-45d6-84d5-360c22ccc03e on hv-cinder-81514 May 26 12:34:03.699542 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2e7d384f-1d95-4551-8070-154e782a80b5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:03.702734 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-2e7d384f-1d95-4551-8070-154e782a80b5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1600 microversion: 2.20 time: 0.531292 May 26 12:34:03.703494 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 125/262] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:34:03 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1600 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:34:03.703606 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-246fd09d-15cf-4efc-b643-7676b4a35395 req-21e15f3f-85ae-4864-b212-be3549f386a1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032174 May 26 12:34:03.704219 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 138/263] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:34:03.709201 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-cb88a50c-48f7-4653-9815-19e6ea60863c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:03.709964 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-cb88a50c-48f7-4653-9815-19e6ea60863c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:03.719237 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cb88a50c-48f7-4653-9815-19e6ea60863c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:03.719696 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cb88a50c-48f7-4653-9815-19e6ea60863c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:03.720572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cb88a50c-48f7-4653-9815-19e6ea60863c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:03.721042 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cb88a50c-48f7-4653-9815-19e6ea60863c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:03.723241 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-45703bce-99ee-4564-87f7-8dcf7edbc115 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:03.723941 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-45703bce-99ee-4564-87f7-8dcf7edbc115 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:03.731653 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-45703bce-99ee-4564-87f7-8dcf7edbc115 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:03.732105 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-45703bce-99ee-4564-87f7-8dcf7edbc115 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:03.733806 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-45703bce-99ee-4564-87f7-8dcf7edbc115 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:03.734601 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-45703bce-99ee-4564-87f7-8dcf7edbc115 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:03.887301 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-45703bce-99ee-4564-87f7-8dcf7edbc115 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.168961 May 26 12:34:03.888327 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 139/264] 10.222.0.39 () {60 vars in 1315 bytes} [Thu May 26 12:34:03 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c/os-interface => generated 285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 12:34:03.921975 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-cb88a50c-48f7-4653-9815-19e6ea60863c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:03.930054 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-cb88a50c-48f7-4653-9815-19e6ea60863c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.224702 May 26 12:34:03.930774 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 126/265] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:03 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:04.686943 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-4670e163-1ef1-4fef-a5d3-e15366fb38ce tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:04.687728 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-4670e163-1ef1-4fef-a5d3-e15366fb38ce tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:04.695878 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4670e163-1ef1-4fef-a5d3-e15366fb38ce tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:04.696335 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4670e163-1ef1-4fef-a5d3-e15366fb38ce tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:04.697166 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4670e163-1ef1-4fef-a5d3-e15366fb38ce tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:04.697778 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4670e163-1ef1-4fef-a5d3-e15366fb38ce tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:04.907689 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-4670e163-1ef1-4fef-a5d3-e15366fb38ce tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:04.921837 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-4670e163-1ef1-4fef-a5d3-e15366fb38ce tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.239143 May 26 12:34:04.922646 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 140/266] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:04 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:04.947627 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-dcc203bb-bee3-4d2d-913d-e2aca1ae970d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:04.948387 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-dcc203bb-bee3-4d2d-913d-e2aca1ae970d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:04.955749 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-dcc203bb-bee3-4d2d-913d-e2aca1ae970d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:04.956200 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-dcc203bb-bee3-4d2d-913d-e2aca1ae970d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:04.957326 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-dcc203bb-bee3-4d2d-913d-e2aca1ae970d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:04.957958 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-dcc203bb-bee3-4d2d-913d-e2aca1ae970d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:05.133654 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-dcc203bb-bee3-4d2d-913d-e2aca1ae970d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:05.146576 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-dcc203bb-bee3-4d2d-913d-e2aca1ae970d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.203532 May 26 12:34:05.147414 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 127/267] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:04 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:05.272116 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-8f662282-c172-49c0-b887-a1bb842da47e req-e6328127-a9f1-48b5-bcdf-98c7a506297b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7af16d0b-59c7-43ea-856c-ec79029b680c", "tag": "b1b5ee45-e743-4819-bc49-534e21eec9a7"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:34:05.281792 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-8f662282-c172-49c0-b887-a1bb842da47e req-e6328127-a9f1-48b5-bcdf-98c7a506297b service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:05.282240 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-8f662282-c172-49c0-b887-a1bb842da47e req-e6328127-a9f1-48b5-bcdf-98c7a506297b service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:05.295583 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-8f662282-c172-49c0-b887-a1bb842da47e req-e6328127-a9f1-48b5-bcdf-98c7a506297b service nova] Creating event network-changed:b1b5ee45-e743-4819-bc49-534e21eec9a7 for instance 7af16d0b-59c7-43ea-856c-ec79029b680c on hv-cinder-81514 May 26 12:34:05.302181 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-8f662282-c172-49c0-b887-a1bb842da47e req-e6328127-a9f1-48b5-bcdf-98c7a506297b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035018 May 26 12:34:05.303028 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 141/268] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:34:05.940280 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-4cbbca9d-5c4c-4cd7-a3f8-afc5318b5274 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:05.941222 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-4cbbca9d-5c4c-4cd7-a3f8-afc5318b5274 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:05.948473 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4cbbca9d-5c4c-4cd7-a3f8-afc5318b5274 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:05.949078 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4cbbca9d-5c4c-4cd7-a3f8-afc5318b5274 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:05.949765 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4cbbca9d-5c4c-4cd7-a3f8-afc5318b5274 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:05.950210 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4cbbca9d-5c4c-4cd7-a3f8-afc5318b5274 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:06.090831 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-4cbbca9d-5c4c-4cd7-a3f8-afc5318b5274 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:06.100335 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-4cbbca9d-5c4c-4cd7-a3f8-afc5318b5274 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.164778 May 26 12:34:06.100939 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 128/269] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:05 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:06.165428 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-72eeac1b-e796-4307-af93-1b5668ffbfe4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:06.166666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-72eeac1b-e796-4307-af93-1b5668ffbfe4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:06.173454 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-72eeac1b-e796-4307-af93-1b5668ffbfe4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:06.173912 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-72eeac1b-e796-4307-af93-1b5668ffbfe4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:06.174685 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-72eeac1b-e796-4307-af93-1b5668ffbfe4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:06.175127 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-72eeac1b-e796-4307-af93-1b5668ffbfe4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:06.191509 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=100 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:06.328027 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-72eeac1b-e796-4307-af93-1b5668ffbfe4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:06.337888 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-72eeac1b-e796-4307-af93-1b5668ffbfe4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.177837 May 26 12:34:06.338547 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 142/270] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:06 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:34:07.117920 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-87a722bd-f40e-42b3-b623-386e4d2a37eb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:07.118609 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-87a722bd-f40e-42b3-b623-386e4d2a37eb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:07.125144 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-87a722bd-f40e-42b3-b623-386e4d2a37eb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:07.125726 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-87a722bd-f40e-42b3-b623-386e4d2a37eb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:07.126603 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-87a722bd-f40e-42b3-b623-386e4d2a37eb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:07.127099 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-87a722bd-f40e-42b3-b623-386e4d2a37eb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:07.257921 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-87a722bd-f40e-42b3-b623-386e4d2a37eb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:07.266312 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-87a722bd-f40e-42b3-b623-386e4d2a37eb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.152621 May 26 12:34:07.266879 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 129/271] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:07 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:07.354016 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d1ce3055-d2ff-4ae4-a4c4-9868408f255e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:07.354623 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d1ce3055-d2ff-4ae4-a4c4-9868408f255e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:07.360683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d1ce3055-d2ff-4ae4-a4c4-9868408f255e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:07.361160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d1ce3055-d2ff-4ae4-a4c4-9868408f255e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:07.361908 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d1ce3055-d2ff-4ae4-a4c4-9868408f255e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:07.362337 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d1ce3055-d2ff-4ae4-a4c4-9868408f255e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:07.500690 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d1ce3055-d2ff-4ae4-a4c4-9868408f255e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:07.510758 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-d1ce3055-d2ff-4ae4-a4c4-9868408f255e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.158315 May 26 12:34:07.510758 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 143/272] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:07 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:08.283309 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b9678ff8-e8ff-460f-b386-7abd0cbec932 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:08.283914 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b9678ff8-e8ff-460f-b386-7abd0cbec932 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:08.291244 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b9678ff8-e8ff-460f-b386-7abd0cbec932 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:08.291696 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b9678ff8-e8ff-460f-b386-7abd0cbec932 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:08.292453 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b9678ff8-e8ff-460f-b386-7abd0cbec932 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:08.292925 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b9678ff8-e8ff-460f-b386-7abd0cbec932 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:08.423718 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b9678ff8-e8ff-460f-b386-7abd0cbec932 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:08.432191 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b9678ff8-e8ff-460f-b386-7abd0cbec932 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.152699 May 26 12:34:08.432797 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 130/273] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:08 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:08.527480 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-15d27d68-4dde-4838-81aa-951235925505 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:08.528346 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-15d27d68-4dde-4838-81aa-951235925505 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:08.534823 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-15d27d68-4dde-4838-81aa-951235925505 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:08.535282 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-15d27d68-4dde-4838-81aa-951235925505 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:08.536056 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-15d27d68-4dde-4838-81aa-951235925505 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:08.536787 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-15d27d68-4dde-4838-81aa-951235925505 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:08.933720 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-15d27d68-4dde-4838-81aa-951235925505 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:08.942468 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-15d27d68-4dde-4838-81aa-951235925505 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.419599 May 26 12:34:08.943139 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 144/274] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:08 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:09.451044 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-be8b3cd5-afef-44a4-a38e-80eb66c6346b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:09.452544 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-be8b3cd5-afef-44a4-a38e-80eb66c6346b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:09.459603 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-be8b3cd5-afef-44a4-a38e-80eb66c6346b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:09.460051 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-be8b3cd5-afef-44a4-a38e-80eb66c6346b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:09.461128 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-be8b3cd5-afef-44a4-a38e-80eb66c6346b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:09.461570 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-be8b3cd5-afef-44a4-a38e-80eb66c6346b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:09.587874 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-be8b3cd5-afef-44a4-a38e-80eb66c6346b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:09.595200 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-be8b3cd5-afef-44a4-a38e-80eb66c6346b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.149842 May 26 12:34:09.595758 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 131/275] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:09 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:09.959668 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-7579f254-890c-4b34-9210-9879e2a860f3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:09.960495 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-7579f254-890c-4b34-9210-9879e2a860f3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:09.967807 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7579f254-890c-4b34-9210-9879e2a860f3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:09.968255 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7579f254-890c-4b34-9210-9879e2a860f3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:09.969044 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7579f254-890c-4b34-9210-9879e2a860f3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:09.969479 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7579f254-890c-4b34-9210-9879e2a860f3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:10.125460 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-7579f254-890c-4b34-9210-9879e2a860f3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:10.133616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-7579f254-890c-4b34-9210-9879e2a860f3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.177990 May 26 12:34:10.134190 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 145/276] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:09 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:10.611997 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-4873f80c-fb6b-42ad-a8ba-2bdff4b9e841 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:10.612608 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-4873f80c-fb6b-42ad-a8ba-2bdff4b9e841 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:10.619245 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4873f80c-fb6b-42ad-a8ba-2bdff4b9e841 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:10.619693 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4873f80c-fb6b-42ad-a8ba-2bdff4b9e841 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:10.620449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4873f80c-fb6b-42ad-a8ba-2bdff4b9e841 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:10.620938 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4873f80c-fb6b-42ad-a8ba-2bdff4b9e841 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:10.750872 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-4873f80c-fb6b-42ad-a8ba-2bdff4b9e841 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:10.758710 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-4873f80c-fb6b-42ad-a8ba-2bdff4b9e841 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.150551 May 26 12:34:10.759267 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 132/277] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:10 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:11.152806 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-19fa1240-a04d-40b4-8426-6d7edb5f3529 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:11.154301 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-19fa1240-a04d-40b4-8426-6d7edb5f3529 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:11.161195 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-19fa1240-a04d-40b4-8426-6d7edb5f3529 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:11.161735 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-19fa1240-a04d-40b4-8426-6d7edb5f3529 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:11.162568 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-19fa1240-a04d-40b4-8426-6d7edb5f3529 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:11.163009 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-19fa1240-a04d-40b4-8426-6d7edb5f3529 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:11.293460 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-19fa1240-a04d-40b4-8426-6d7edb5f3529 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:11.300815 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-19fa1240-a04d-40b4-8426-6d7edb5f3529 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.153418 May 26 12:34:11.301364 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 146/278] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:11 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:11.777214 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-84f0af2b-0374-49be-a328-900901140f13 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:11.777886 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-84f0af2b-0374-49be-a328-900901140f13 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:11.784228 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-84f0af2b-0374-49be-a328-900901140f13 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:11.784674 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-84f0af2b-0374-49be-a328-900901140f13 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:11.785446 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-84f0af2b-0374-49be-a328-900901140f13 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:11.785876 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-84f0af2b-0374-49be-a328-900901140f13 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:11.915624 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-84f0af2b-0374-49be-a328-900901140f13 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:11.923048 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-84f0af2b-0374-49be-a328-900901140f13 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.151466 May 26 12:34:11.923604 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 133/279] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:11 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:12.317638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-b408cb7d-097b-4b20-b153-4ee01a5fbe06 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:12.318238 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-b408cb7d-097b-4b20-b153-4ee01a5fbe06 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:12.324732 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b408cb7d-097b-4b20-b153-4ee01a5fbe06 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:12.325178 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b408cb7d-097b-4b20-b153-4ee01a5fbe06 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:12.325925 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b408cb7d-097b-4b20-b153-4ee01a5fbe06 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:12.326356 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b408cb7d-097b-4b20-b153-4ee01a5fbe06 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:12.453231 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-b408cb7d-097b-4b20-b153-4ee01a5fbe06 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:12.460588 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-b408cb7d-097b-4b20-b153-4ee01a5fbe06 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.146563 May 26 12:34:12.461260 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 147/280] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:12 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:12.939608 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-7e146029-5b20-4a5a-af88-271ffbf9f3ca tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:12.940207 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-7e146029-5b20-4a5a-af88-271ffbf9f3ca tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:12.947032 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7e146029-5b20-4a5a-af88-271ffbf9f3ca tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:12.947474 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7e146029-5b20-4a5a-af88-271ffbf9f3ca tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:12.948222 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7e146029-5b20-4a5a-af88-271ffbf9f3ca tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:12.948737 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7e146029-5b20-4a5a-af88-271ffbf9f3ca tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:13.077904 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-7e146029-5b20-4a5a-af88-271ffbf9f3ca tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:13.085894 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-7e146029-5b20-4a5a-af88-271ffbf9f3ca tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.149541 May 26 12:34:13.086601 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 134/281] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:12 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:13.477388 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-2c96866e-c21c-487f-bc7c-bf0b374e5fa8 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:13.478003 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-2c96866e-c21c-487f-bc7c-bf0b374e5fa8 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:13.483974 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2c96866e-c21c-487f-bc7c-bf0b374e5fa8 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:13.484428 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2c96866e-c21c-487f-bc7c-bf0b374e5fa8 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:13.485218 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2c96866e-c21c-487f-bc7c-bf0b374e5fa8 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:13.485658 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2c96866e-c21c-487f-bc7c-bf0b374e5fa8 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:13.612408 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-2c96866e-c21c-487f-bc7c-bf0b374e5fa8 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:13.620371 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-2c96866e-c21c-487f-bc7c-bf0b374e5fa8 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.147616 May 26 12:34:13.620966 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 148/282] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:13 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:34:14.102187 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-31807d36-2d73-41df-a474-787107ff734e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:14.102870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-31807d36-2d73-41df-a474-787107ff734e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:14.109457 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-31807d36-2d73-41df-a474-787107ff734e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:14.109846 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-31807d36-2d73-41df-a474-787107ff734e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:14.110598 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-31807d36-2d73-41df-a474-787107ff734e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:14.111036 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-31807d36-2d73-41df-a474-787107ff734e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:14.246168 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-31807d36-2d73-41df-a474-787107ff734e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:14.253573 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-31807d36-2d73-41df-a474-787107ff734e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.155221 May 26 12:34:14.254133 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 135/283] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:14 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:14.637046 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-353ca695-6011-42c1-a9a9-0b7606f05ef5 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:14.637928 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-353ca695-6011-42c1-a9a9-0b7606f05ef5 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:14.643920 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-353ca695-6011-42c1-a9a9-0b7606f05ef5 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:14.644384 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-353ca695-6011-42c1-a9a9-0b7606f05ef5 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:14.645170 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-353ca695-6011-42c1-a9a9-0b7606f05ef5 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:14.645618 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-353ca695-6011-42c1-a9a9-0b7606f05ef5 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:14.775513 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-353ca695-6011-42c1-a9a9-0b7606f05ef5 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:14.784849 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-353ca695-6011-42c1-a9a9-0b7606f05ef5 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.151644 May 26 12:34:14.785407 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 149/284] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:14 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:34:15.273511 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-967e6981-8911-4468-92f0-8b4a1fe1c6be tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:15.274166 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-967e6981-8911-4468-92f0-8b4a1fe1c6be tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:15.280568 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-967e6981-8911-4468-92f0-8b4a1fe1c6be tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:15.281073 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-967e6981-8911-4468-92f0-8b4a1fe1c6be tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:15.281828 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-967e6981-8911-4468-92f0-8b4a1fe1c6be tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:15.282267 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-967e6981-8911-4468-92f0-8b4a1fe1c6be tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:15.418577 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-967e6981-8911-4468-92f0-8b4a1fe1c6be tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:15.420882 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=100 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:15.427213 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-967e6981-8911-4468-92f0-8b4a1fe1c6be tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.158150 May 26 12:34:15.427766 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 136/285] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:15 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:15.802690 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-b7a28221-abe1-4ee5-90ce-071c87e94d1b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:15.803306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-b7a28221-abe1-4ee5-90ce-071c87e94d1b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:15.805461 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=72 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:15.811302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b7a28221-abe1-4ee5-90ce-071c87e94d1b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:15.811763 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b7a28221-abe1-4ee5-90ce-071c87e94d1b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:15.812525 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b7a28221-abe1-4ee5-90ce-071c87e94d1b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:15.812996 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b7a28221-abe1-4ee5-90ce-071c87e94d1b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:15.948454 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-b7a28221-abe1-4ee5-90ce-071c87e94d1b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:15.955771 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-b7a28221-abe1-4ee5-90ce-071c87e94d1b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.156986 May 26 12:34:15.956319 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 150/286] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:15 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:16.443025 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b46e6bf3-8722-4aea-b0a1-4a53222bf72d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:16.443622 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b46e6bf3-8722-4aea-b0a1-4a53222bf72d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:16.450542 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b46e6bf3-8722-4aea-b0a1-4a53222bf72d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:16.450989 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b46e6bf3-8722-4aea-b0a1-4a53222bf72d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:16.451737 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b46e6bf3-8722-4aea-b0a1-4a53222bf72d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:16.452417 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b46e6bf3-8722-4aea-b0a1-4a53222bf72d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:16.579284 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b46e6bf3-8722-4aea-b0a1-4a53222bf72d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:16.587278 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b46e6bf3-8722-4aea-b0a1-4a53222bf72d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.147981 May 26 12:34:16.587841 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 137/287] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:16 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:16.973320 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-0736dae8-ca78-4a3e-b476-56cb32246d23 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:16.973934 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-0736dae8-ca78-4a3e-b476-56cb32246d23 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:16.981805 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0736dae8-ca78-4a3e-b476-56cb32246d23 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:16.982253 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0736dae8-ca78-4a3e-b476-56cb32246d23 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:16.983015 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0736dae8-ca78-4a3e-b476-56cb32246d23 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:16.983453 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0736dae8-ca78-4a3e-b476-56cb32246d23 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:17.122034 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-0736dae8-ca78-4a3e-b476-56cb32246d23 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:17.129419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-0736dae8-ca78-4a3e-b476-56cb32246d23 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.159965 May 26 12:34:17.129981 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 151/288] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:16 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:17.603987 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-9d26dd56-617a-42e0-8210-ea623bd4a082 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:17.604584 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-9d26dd56-617a-42e0-8210-ea623bd4a082 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:17.611105 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9d26dd56-617a-42e0-8210-ea623bd4a082 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:17.611547 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9d26dd56-617a-42e0-8210-ea623bd4a082 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:17.612293 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9d26dd56-617a-42e0-8210-ea623bd4a082 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:17.612735 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9d26dd56-617a-42e0-8210-ea623bd4a082 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:17.737515 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-9d26dd56-617a-42e0-8210-ea623bd4a082 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:17.745765 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-9d26dd56-617a-42e0-8210-ea623bd4a082 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.145721 May 26 12:34:17.746326 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 138/289] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:17 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:18.146065 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f4f6b9da-ad06-41d1-b066-65c83cddf885 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:18.146671 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f4f6b9da-ad06-41d1-b066-65c83cddf885 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:18.152706 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f4f6b9da-ad06-41d1-b066-65c83cddf885 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:18.153191 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f4f6b9da-ad06-41d1-b066-65c83cddf885 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:18.153942 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f4f6b9da-ad06-41d1-b066-65c83cddf885 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:18.154378 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f4f6b9da-ad06-41d1-b066-65c83cddf885 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:18.282408 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f4f6b9da-ad06-41d1-b066-65c83cddf885 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:18.290396 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f4f6b9da-ad06-41d1-b066-65c83cddf885 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.148079 May 26 12:34:18.290955 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 152/290] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:18 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:34:18.764491 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-ec159541-b9cf-414c-8ef3-f08368608818 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:18.765068 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-ec159541-b9cf-414c-8ef3-f08368608818 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:18.773822 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ec159541-b9cf-414c-8ef3-f08368608818 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:18.774267 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ec159541-b9cf-414c-8ef3-f08368608818 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:18.775034 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ec159541-b9cf-414c-8ef3-f08368608818 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:18.775472 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ec159541-b9cf-414c-8ef3-f08368608818 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:18.905754 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ec159541-b9cf-414c-8ef3-f08368608818 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:18.913629 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-ec159541-b9cf-414c-8ef3-f08368608818 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.153678 May 26 12:34:18.914185 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 139/291] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:18 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:19.307279 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-cdf3e5ab-057a-4d04-bb48-97730e94082a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:19.307879 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-cdf3e5ab-057a-4d04-bb48-97730e94082a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:19.313949 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cdf3e5ab-057a-4d04-bb48-97730e94082a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:19.314402 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cdf3e5ab-057a-4d04-bb48-97730e94082a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:19.315154 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cdf3e5ab-057a-4d04-bb48-97730e94082a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:19.315591 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cdf3e5ab-057a-4d04-bb48-97730e94082a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:19.440599 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-cdf3e5ab-057a-4d04-bb48-97730e94082a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:19.448635 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-cdf3e5ab-057a-4d04-bb48-97730e94082a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.145696 May 26 12:34:19.449212 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 153/292] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:19 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:19.930772 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b21e2988-d36d-4c5a-9ecf-9bc9565e29ba tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:19.931380 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b21e2988-d36d-4c5a-9ecf-9bc9565e29ba tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:19.937928 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b21e2988-d36d-4c5a-9ecf-9bc9565e29ba tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:19.938383 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b21e2988-d36d-4c5a-9ecf-9bc9565e29ba tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:19.939147 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b21e2988-d36d-4c5a-9ecf-9bc9565e29ba tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:19.939589 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b21e2988-d36d-4c5a-9ecf-9bc9565e29ba tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:20.070752 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b21e2988-d36d-4c5a-9ecf-9bc9565e29ba tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:20.078491 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b21e2988-d36d-4c5a-9ecf-9bc9565e29ba tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.152186 May 26 12:34:20.079312 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 140/293] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:19 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:20.465824 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-8369d25c-acb0-4ac8-a2d3-5a93aa64aeae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:20.466429 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-8369d25c-acb0-4ac8-a2d3-5a93aa64aeae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:20.472420 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8369d25c-acb0-4ac8-a2d3-5a93aa64aeae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:20.472907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8369d25c-acb0-4ac8-a2d3-5a93aa64aeae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:20.473658 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8369d25c-acb0-4ac8-a2d3-5a93aa64aeae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:20.474092 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8369d25c-acb0-4ac8-a2d3-5a93aa64aeae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:20.634545 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-8369d25c-acb0-4ac8-a2d3-5a93aa64aeae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:20.642536 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-8369d25c-acb0-4ac8-a2d3-5a93aa64aeae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.180549 May 26 12:34:20.643353 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 154/294] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:20 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:21.095774 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-06f8cf2e-e71b-43ae-9cf9-f0f9cbe382c1 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:21.096372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-06f8cf2e-e71b-43ae-9cf9-f0f9cbe382c1 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:21.103614 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-06f8cf2e-e71b-43ae-9cf9-f0f9cbe382c1 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:21.104058 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-06f8cf2e-e71b-43ae-9cf9-f0f9cbe382c1 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:21.104890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-06f8cf2e-e71b-43ae-9cf9-f0f9cbe382c1 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:21.105329 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-06f8cf2e-e71b-43ae-9cf9-f0f9cbe382c1 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:21.238636 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-06f8cf2e-e71b-43ae-9cf9-f0f9cbe382c1 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:21.246529 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-06f8cf2e-e71b-43ae-9cf9-f0f9cbe382c1 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.154811 May 26 12:34:21.247082 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 141/295] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:21 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:21.658750 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-195e123b-7735-4d96-b282-278371d0cfba tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:21.659447 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-195e123b-7735-4d96-b282-278371d0cfba tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:21.668411 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-195e123b-7735-4d96-b282-278371d0cfba tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:21.668897 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-195e123b-7735-4d96-b282-278371d0cfba tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:21.669699 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-195e123b-7735-4d96-b282-278371d0cfba tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:21.670136 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-195e123b-7735-4d96-b282-278371d0cfba tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:21.806291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-195e123b-7735-4d96-b282-278371d0cfba tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:21.813745 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-195e123b-7735-4d96-b282-278371d0cfba tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.159127 May 26 12:34:21.814298 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 155/296] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:21 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:22.263974 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f30dab68-b8f5-4907-8d04-73a9aef45a20 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:22.264573 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-f30dab68-b8f5-4907-8d04-73a9aef45a20 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:22.266850 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=64 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:22.272704 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f30dab68-b8f5-4907-8d04-73a9aef45a20 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:22.273271 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f30dab68-b8f5-4907-8d04-73a9aef45a20 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:22.274029 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f30dab68-b8f5-4907-8d04-73a9aef45a20 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:22.274496 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f30dab68-b8f5-4907-8d04-73a9aef45a20 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:22.405141 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-f30dab68-b8f5-4907-8d04-73a9aef45a20 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:22.413242 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-f30dab68-b8f5-4907-8d04-73a9aef45a20 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.152756 May 26 12:34:22.413884 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 142/297] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:22 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:22.831349 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-32294f43-c398-46fe-a42b-fe459f44c73b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:22.831953 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-32294f43-c398-46fe-a42b-fe459f44c73b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:22.838907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-32294f43-c398-46fe-a42b-fe459f44c73b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:22.839356 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-32294f43-c398-46fe-a42b-fe459f44c73b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:22.840110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-32294f43-c398-46fe-a42b-fe459f44c73b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:22.840546 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-32294f43-c398-46fe-a42b-fe459f44c73b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:22.974678 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-32294f43-c398-46fe-a42b-fe459f44c73b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:22.983466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-32294f43-c398-46fe-a42b-fe459f44c73b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1321 microversion: 2.1 time: 0.155836 May 26 12:34:22.984107 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 156/298] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:22 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:23.431694 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-fcf3d5f5-6b00-4eb1-a0b5-ae1a407fae06 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:23.432299 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-fcf3d5f5-6b00-4eb1-a0b5-ae1a407fae06 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:23.438893 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fcf3d5f5-6b00-4eb1-a0b5-ae1a407fae06 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:23.439344 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fcf3d5f5-6b00-4eb1-a0b5-ae1a407fae06 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:23.440108 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fcf3d5f5-6b00-4eb1-a0b5-ae1a407fae06 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:23.440544 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fcf3d5f5-6b00-4eb1-a0b5-ae1a407fae06 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:23.582478 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-fcf3d5f5-6b00-4eb1-a0b5-ae1a407fae06 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:23.591148 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-fcf3d5f5-6b00-4eb1-a0b5-ae1a407fae06 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.163444 May 26 12:34:23.591713 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 143/299] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:23 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:24.000532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-62f92c95-bf43-4fe1-a3d3-178612f88b58 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:24.001212 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-62f92c95-bf43-4fe1-a3d3-178612f88b58 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:24.007390 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-62f92c95-bf43-4fe1-a3d3-178612f88b58 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:24.007848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-62f92c95-bf43-4fe1-a3d3-178612f88b58 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:24.008616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-62f92c95-bf43-4fe1-a3d3-178612f88b58 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:24.009094 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-62f92c95-bf43-4fe1-a3d3-178612f88b58 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:24.183559 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-62f92c95-bf43-4fe1-a3d3-178612f88b58 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:24.192304 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-62f92c95-bf43-4fe1-a3d3-178612f88b58 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1516 microversion: 2.1 time: 0.195705 May 26 12:34:24.193528 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 157/300] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:23 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1516 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:24.212754 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6ddb31a6-d20a-4d67-9eb4-1edad1dbc6ac tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:34:24.213772 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-6ddb31a6-d20a-4d67-9eb4-1edad1dbc6ac tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:24.219971 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6ddb31a6-d20a-4d67-9eb4-1edad1dbc6ac tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:24.220420 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6ddb31a6-d20a-4d67-9eb4-1edad1dbc6ac tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:24.221358 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6ddb31a6-d20a-4d67-9eb4-1edad1dbc6ac tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:24.224762 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6ddb31a6-d20a-4d67-9eb4-1edad1dbc6ac tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:24.245934 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.objects.instance [None req-6ddb31a6-d20a-4d67-9eb4-1edad1dbc6ac tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lazy-loading 'flavor' on Instance uuid ff659e6a-5e2b-45d6-84d5-360c22ccc03e {{(pid=124134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:34:24.363986 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-6ddb31a6-d20a-4d67-9eb4-1edad1dbc6ac tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "POST /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e/action" status: 200 len: 32 microversion: 2.1 time: 0.157129 May 26 12:34:24.364597 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 144/301] 10.222.0.39 () {60 vars in 1277 bytes} [Thu May 26 12:34:24 2022] POST /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:34:24.373967 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-9338cf8f-573b-400e-86f8-5d977ca9c586 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:24.374573 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-9338cf8f-573b-400e-86f8-5d977ca9c586 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:24.380581 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9338cf8f-573b-400e-86f8-5d977ca9c586 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:24.381071 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9338cf8f-573b-400e-86f8-5d977ca9c586 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:24.381848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9338cf8f-573b-400e-86f8-5d977ca9c586 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:24.382288 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9338cf8f-573b-400e-86f8-5d977ca9c586 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:24.510744 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-9338cf8f-573b-400e-86f8-5d977ca9c586 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:24.518416 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-9338cf8f-573b-400e-86f8-5d977ca9c586 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.148477 May 26 12:34:24.519035 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 158/302] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:24 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:24.608258 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-de73baf5-e791-4400-811f-1216b5a54c5d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:24.608980 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-de73baf5-e791-4400-811f-1216b5a54c5d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:24.616763 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-de73baf5-e791-4400-811f-1216b5a54c5d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:24.617216 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-de73baf5-e791-4400-811f-1216b5a54c5d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:24.617980 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-de73baf5-e791-4400-811f-1216b5a54c5d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:24.618421 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-de73baf5-e791-4400-811f-1216b5a54c5d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:24.754967 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-de73baf5-e791-4400-811f-1216b5a54c5d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:24.762971 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-de73baf5-e791-4400-811f-1216b5a54c5d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.159014 May 26 12:34:24.763527 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 145/303] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:24 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:25.535263 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-7045fdbc-2fb0-42be-adc4-893452663695 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:25.535859 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-7045fdbc-2fb0-42be-adc4-893452663695 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:25.542345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7045fdbc-2fb0-42be-adc4-893452663695 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:25.542820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7045fdbc-2fb0-42be-adc4-893452663695 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:25.543568 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7045fdbc-2fb0-42be-adc4-893452663695 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:25.544034 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7045fdbc-2fb0-42be-adc4-893452663695 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:25.546724 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=100 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:25.669721 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-7045fdbc-2fb0-42be-adc4-893452663695 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:25.677095 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-7045fdbc-2fb0-42be-adc4-893452663695 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.145622 May 26 12:34:25.677643 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 159/304] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:25 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:25.779959 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-57e24ef2-9914-4f5f-906a-9cd6f205a4a3 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:25.780596 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-57e24ef2-9914-4f5f-906a-9cd6f205a4a3 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:25.787067 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-57e24ef2-9914-4f5f-906a-9cd6f205a4a3 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:25.787513 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-57e24ef2-9914-4f5f-906a-9cd6f205a4a3 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:25.789000 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-57e24ef2-9914-4f5f-906a-9cd6f205a4a3 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:25.789442 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-57e24ef2-9914-4f5f-906a-9cd6f205a4a3 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:25.922840 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-57e24ef2-9914-4f5f-906a-9cd6f205a4a3 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:25.930473 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-57e24ef2-9914-4f5f-906a-9cd6f205a4a3 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.154325 May 26 12:34:25.931039 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 146/305] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:25 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:26.694175 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-61caacbc-f349-442c-9f07-8280cdc3fa5a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:26.694901 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-61caacbc-f349-442c-9f07-8280cdc3fa5a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:26.700996 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-61caacbc-f349-442c-9f07-8280cdc3fa5a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:26.701501 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-61caacbc-f349-442c-9f07-8280cdc3fa5a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:26.702202 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-61caacbc-f349-442c-9f07-8280cdc3fa5a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:26.702634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-61caacbc-f349-442c-9f07-8280cdc3fa5a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:26.849183 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-61caacbc-f349-442c-9f07-8280cdc3fa5a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:26.859613 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-61caacbc-f349-442c-9f07-8280cdc3fa5a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.168937 May 26 12:34:26.860170 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 160/306] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:26 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:26.948913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6b635620-b662-46d1-829a-4dc4f6027360 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:26.950869 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-6b635620-b662-46d1-829a-4dc4f6027360 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:26.959028 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6b635620-b662-46d1-829a-4dc4f6027360 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:26.959409 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6b635620-b662-46d1-829a-4dc4f6027360 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:26.960183 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6b635620-b662-46d1-829a-4dc4f6027360 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:26.961283 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6b635620-b662-46d1-829a-4dc4f6027360 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:27.104426 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-6b635620-b662-46d1-829a-4dc4f6027360 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:27.113238 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-6b635620-b662-46d1-829a-4dc4f6027360 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.169611 May 26 12:34:27.120857 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 147/307] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:26 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:27.876511 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-b3bc2c93-2058-45b3-a7cf-71a5213b10fb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:27.877290 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-b3bc2c93-2058-45b3-a7cf-71a5213b10fb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:27.885516 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b3bc2c93-2058-45b3-a7cf-71a5213b10fb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:27.886049 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b3bc2c93-2058-45b3-a7cf-71a5213b10fb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:27.887387 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b3bc2c93-2058-45b3-a7cf-71a5213b10fb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:27.887964 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b3bc2c93-2058-45b3-a7cf-71a5213b10fb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:28.022777 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-b3bc2c93-2058-45b3-a7cf-71a5213b10fb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:28.030690 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-b3bc2c93-2058-45b3-a7cf-71a5213b10fb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.157937 May 26 12:34:28.031321 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 161/308] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:27 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:28.131232 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-41b2588e-fd2f-49d4-8b5d-0c257cda847c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:28.131839 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-41b2588e-fd2f-49d4-8b5d-0c257cda847c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:28.139493 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-41b2588e-fd2f-49d4-8b5d-0c257cda847c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:28.139946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-41b2588e-fd2f-49d4-8b5d-0c257cda847c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:28.140741 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-41b2588e-fd2f-49d4-8b5d-0c257cda847c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:28.141173 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-41b2588e-fd2f-49d4-8b5d-0c257cda847c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:28.330177 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-41b2588e-fd2f-49d4-8b5d-0c257cda847c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:28.338324 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-41b2588e-fd2f-49d4-8b5d-0c257cda847c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.210900 May 26 12:34:28.338976 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 148/309] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:28 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:29.048070 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-8983dfa4-b782-481f-90d7-e7faace2d858 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:29.048612 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-8983dfa4-b782-481f-90d7-e7faace2d858 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:29.055364 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8983dfa4-b782-481f-90d7-e7faace2d858 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:29.055811 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8983dfa4-b782-481f-90d7-e7faace2d858 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:29.056575 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8983dfa4-b782-481f-90d7-e7faace2d858 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:29.057070 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8983dfa4-b782-481f-90d7-e7faace2d858 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:29.203505 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-8983dfa4-b782-481f-90d7-e7faace2d858 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:29.210964 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-8983dfa4-b782-481f-90d7-e7faace2d858 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.166778 May 26 12:34:29.211680 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 162/310] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:29 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:29.356440 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-fc4c1f58-349b-4841-a64c-388eaa01fea7 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:29.357196 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-fc4c1f58-349b-4841-a64c-388eaa01fea7 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:29.363748 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fc4c1f58-349b-4841-a64c-388eaa01fea7 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:29.364265 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fc4c1f58-349b-4841-a64c-388eaa01fea7 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:29.365293 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fc4c1f58-349b-4841-a64c-388eaa01fea7 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:29.365590 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fc4c1f58-349b-4841-a64c-388eaa01fea7 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:29.499483 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-fc4c1f58-349b-4841-a64c-388eaa01fea7 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:29.507896 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-fc4c1f58-349b-4841-a64c-388eaa01fea7 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.154618 May 26 12:34:29.508471 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 149/311] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:29 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:30.227353 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-73a2de0c-def0-47a2-b581-17a6a374ba26 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:30.228062 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-73a2de0c-def0-47a2-b581-17a6a374ba26 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:30.234334 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-73a2de0c-def0-47a2-b581-17a6a374ba26 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:30.234785 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-73a2de0c-def0-47a2-b581-17a6a374ba26 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:30.235533 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-73a2de0c-def0-47a2-b581-17a6a374ba26 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:30.235967 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-73a2de0c-def0-47a2-b581-17a6a374ba26 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:30.361425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-73a2de0c-def0-47a2-b581-17a6a374ba26 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:30.369397 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-73a2de0c-def0-47a2-b581-17a6a374ba26 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.145861 May 26 12:34:30.369951 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 163/312] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:30 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:30.525156 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-bce77153-58dd-4612-8546-19c599a85c83 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:30.525761 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-bce77153-58dd-4612-8546-19c599a85c83 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:30.531720 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bce77153-58dd-4612-8546-19c599a85c83 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:30.532165 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bce77153-58dd-4612-8546-19c599a85c83 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:30.532984 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bce77153-58dd-4612-8546-19c599a85c83 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:30.533419 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bce77153-58dd-4612-8546-19c599a85c83 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:30.664464 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-bce77153-58dd-4612-8546-19c599a85c83 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:30.671890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-bce77153-58dd-4612-8546-19c599a85c83 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.150807 May 26 12:34:30.672455 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 150/313] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:30 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:31.386663 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-3c1d4cb9-790b-400b-a222-4c288d60f2ed tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:31.387522 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-3c1d4cb9-790b-400b-a222-4c288d60f2ed tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:31.393858 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3c1d4cb9-790b-400b-a222-4c288d60f2ed tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:31.394306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3c1d4cb9-790b-400b-a222-4c288d60f2ed tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:31.395094 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3c1d4cb9-790b-400b-a222-4c288d60f2ed tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:31.395532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3c1d4cb9-790b-400b-a222-4c288d60f2ed tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:31.524911 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-3c1d4cb9-790b-400b-a222-4c288d60f2ed tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:31.532258 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-3c1d4cb9-790b-400b-a222-4c288d60f2ed tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.150040 May 26 12:34:31.532835 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 164/314] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:31 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:31.689393 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-3c963db4-2bfe-4f73-bdb0-6ab1f31198ba tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:31.689999 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-3c963db4-2bfe-4f73-bdb0-6ab1f31198ba tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:31.697200 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3c963db4-2bfe-4f73-bdb0-6ab1f31198ba tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:31.697649 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3c963db4-2bfe-4f73-bdb0-6ab1f31198ba tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:31.698413 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3c963db4-2bfe-4f73-bdb0-6ab1f31198ba tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:31.698848 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3c963db4-2bfe-4f73-bdb0-6ab1f31198ba tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:31.714341 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:32.079572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-3c963db4-2bfe-4f73-bdb0-6ab1f31198ba tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:32.087846 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-3c963db4-2bfe-4f73-bdb0-6ab1f31198ba tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.402252 May 26 12:34:32.088412 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 151/315] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:31 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:32.549351 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-11e28645-b66e-4900-94ba-ded276649267 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:32.549864 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-11e28645-b66e-4900-94ba-ded276649267 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:32.556957 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-11e28645-b66e-4900-94ba-ded276649267 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:32.557405 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-11e28645-b66e-4900-94ba-ded276649267 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:32.558161 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-11e28645-b66e-4900-94ba-ded276649267 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:32.558594 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-11e28645-b66e-4900-94ba-ded276649267 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:32.691591 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-11e28645-b66e-4900-94ba-ded276649267 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:32.699888 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-11e28645-b66e-4900-94ba-ded276649267 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.154427 May 26 12:34:32.700662 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 165/316] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:32 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:33.104530 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-3fbe4169-33d9-4785-a823-f676a68da12b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:33.105156 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-3fbe4169-33d9-4785-a823-f676a68da12b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:33.111568 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3fbe4169-33d9-4785-a823-f676a68da12b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:33.112012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3fbe4169-33d9-4785-a823-f676a68da12b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:33.112788 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3fbe4169-33d9-4785-a823-f676a68da12b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:33.113225 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3fbe4169-33d9-4785-a823-f676a68da12b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:33.457753 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-3fbe4169-33d9-4785-a823-f676a68da12b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:33.473270 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-3fbe4169-33d9-4785-a823-f676a68da12b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.371905 May 26 12:34:33.475235 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 152/317] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:33 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:33.488927 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-81902dc4-06d3-4cef-89ce-f7a1d1352c80 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:33.489787 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-81902dc4-06d3-4cef-89ce-f7a1d1352c80 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:33.497149 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-81902dc4-06d3-4cef-89ce-f7a1d1352c80 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:33.497744 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-81902dc4-06d3-4cef-89ce-f7a1d1352c80 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:33.498789 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-81902dc4-06d3-4cef-89ce-f7a1d1352c80 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:33.499325 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-81902dc4-06d3-4cef-89ce-f7a1d1352c80 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:33.525898 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-81902dc4-06d3-4cef-89ce-f7a1d1352c80 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Going to try to terminate instance {{(pid=124133) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:34:33.626948 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-81902dc4-06d3-4cef-89ce-f7a1d1352c80 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 204 len: 0 microversion: 2.1 time: 0.142177 May 26 12:34:33.627645 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 166/318] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:34:33 2022] DELETE /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:34:33.638505 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-5fd5e459-7da9-4d28-a5a7-bbfd498afd9c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:33.639528 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-5fd5e459-7da9-4d28-a5a7-bbfd498afd9c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:33.650970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5fd5e459-7da9-4d28-a5a7-bbfd498afd9c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:33.651758 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5fd5e459-7da9-4d28-a5a7-bbfd498afd9c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:33.653449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5fd5e459-7da9-4d28-a5a7-bbfd498afd9c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:33.653885 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5fd5e459-7da9-4d28-a5a7-bbfd498afd9c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:33.717275 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-099b5f03-fb1c-4add-8a65-625bd1402183 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:33.718124 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-099b5f03-fb1c-4add-8a65-625bd1402183 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:33.724287 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-099b5f03-fb1c-4add-8a65-625bd1402183 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:33.724763 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-099b5f03-fb1c-4add-8a65-625bd1402183 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:33.725758 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-099b5f03-fb1c-4add-8a65-625bd1402183 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:33.726361 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-099b5f03-fb1c-4add-8a65-625bd1402183 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:33.892631 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-5fd5e459-7da9-4d28-a5a7-bbfd498afd9c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:33.905787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-5fd5e459-7da9-4d28-a5a7-bbfd498afd9c tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1553 microversion: 2.1 time: 0.273999 May 26 12:34:33.912283 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 153/319] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:33 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1553 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:33.939688 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-099b5f03-fb1c-4add-8a65-625bd1402183 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:33.954110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-099b5f03-fb1c-4add-8a65-625bd1402183 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.240910 May 26 12:34:33.955225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 167/320] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:33 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:34:34.026795 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-2584d913-f4c6-481b-ba55-bd1566217196 req-2e982ad9-3969-4b15-8a65-825d3e3cbf15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7537224-8613-46e8-87db-0b559643c4a8", "name": "network-vif-plugged", "status": "completed", "tag": "dce540cd-4f61-4a97-acbe-502a1728d37c"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:34:34.035117 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-2584d913-f4c6-481b-ba55-bd1566217196 req-2e982ad9-3969-4b15-8a65-825d3e3cbf15 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:34.035841 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-2584d913-f4c6-481b-ba55-bd1566217196 req-2e982ad9-3969-4b15-8a65-825d3e3cbf15 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:34.048138 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-2584d913-f4c6-481b-ba55-bd1566217196 req-2e982ad9-3969-4b15-8a65-825d3e3cbf15 service nova] Creating event network-vif-plugged:dce540cd-4f61-4a97-acbe-502a1728d37c for instance c7537224-8613-46e8-87db-0b559643c4a8 on hv-cinder-81514 May 26 12:34:34.054363 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-2584d913-f4c6-481b-ba55-bd1566217196 req-2e982ad9-3969-4b15-8a65-825d3e3cbf15 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032995 May 26 12:34:34.055902 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 154/321] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:34:34.491046 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-1e0a602e-d66b-4a45-a13d-7385e629fcb5 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:34.492296 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-1e0a602e-d66b-4a45-a13d-7385e629fcb5 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:34.498146 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1e0a602e-d66b-4a45-a13d-7385e629fcb5 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:34.498591 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1e0a602e-d66b-4a45-a13d-7385e629fcb5 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:34.499745 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1e0a602e-d66b-4a45-a13d-7385e629fcb5 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:34.500181 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1e0a602e-d66b-4a45-a13d-7385e629fcb5 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:34.648123 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-1e0a602e-d66b-4a45-a13d-7385e629fcb5 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:34.655601 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-1e0a602e-d66b-4a45-a13d-7385e629fcb5 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.168394 May 26 12:34:34.656351 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 168/322] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:34 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:34.930499 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-c10997c0-dc1b-4e42-a11b-1a4a593e9349 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:34.931307 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-c10997c0-dc1b-4e42-a11b-1a4a593e9349 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:34.937706 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c10997c0-dc1b-4e42-a11b-1a4a593e9349 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:34.938163 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c10997c0-dc1b-4e42-a11b-1a4a593e9349 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:34.938919 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c10997c0-dc1b-4e42-a11b-1a4a593e9349 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:34.939536 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c10997c0-dc1b-4e42-a11b-1a4a593e9349 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:34.973919 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-602169be-26bd-41b6-84cb-3c1954885c7f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:34.974674 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-602169be-26bd-41b6-84cb-3c1954885c7f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:34.981771 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-602169be-26bd-41b6-84cb-3c1954885c7f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:34.982309 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-602169be-26bd-41b6-84cb-3c1954885c7f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:34.983155 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-602169be-26bd-41b6-84cb-3c1954885c7f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:34.983690 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-602169be-26bd-41b6-84cb-3c1954885c7f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:35.222763 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c10997c0-dc1b-4e42-a11b-1a4a593e9349 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:35.244259 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-c10997c0-dc1b-4e42-a11b-1a4a593e9349 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1553 microversion: 2.1 time: 0.318783 May 26 12:34:35.244874 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 155/323] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:34 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1553 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:35.270608 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-602169be-26bd-41b6-84cb-3c1954885c7f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:35.287280 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-602169be-26bd-41b6-84cb-3c1954885c7f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.318570 May 26 12:34:35.289419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 169/324] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:34 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:34:35.672947 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-d2632183-57dd-40f7-a268-6e500ff4b24f tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:35.673561 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-d2632183-57dd-40f7-a268-6e500ff4b24f tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:35.679844 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d2632183-57dd-40f7-a268-6e500ff4b24f tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:35.680295 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d2632183-57dd-40f7-a268-6e500ff4b24f tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:35.681648 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d2632183-57dd-40f7-a268-6e500ff4b24f tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:35.682737 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d2632183-57dd-40f7-a268-6e500ff4b24f tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:35.843064 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d2632183-57dd-40f7-a268-6e500ff4b24f tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:35.858972 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-d2632183-57dd-40f7-a268-6e500ff4b24f tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.189821 May 26 12:34:35.862712 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 156/325] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:35 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:36.261525 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-fa317c03-d7ca-4623-93bd-15ac43797f23 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:36.262610 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-fa317c03-d7ca-4623-93bd-15ac43797f23 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:36.270381 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fa317c03-d7ca-4623-93bd-15ac43797f23 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:36.270840 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fa317c03-d7ca-4623-93bd-15ac43797f23 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:36.271619 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fa317c03-d7ca-4623-93bd-15ac43797f23 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:36.272911 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fa317c03-d7ca-4623-93bd-15ac43797f23 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:36.307096 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-15874677-0fde-4c98-a16c-ea050eb23ca2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:36.308281 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-15874677-0fde-4c98-a16c-ea050eb23ca2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:36.317544 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-15874677-0fde-4c98-a16c-ea050eb23ca2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:36.318221 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-15874677-0fde-4c98-a16c-ea050eb23ca2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:36.319938 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-15874677-0fde-4c98-a16c-ea050eb23ca2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:36.320530 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-15874677-0fde-4c98-a16c-ea050eb23ca2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:36.543392 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-fa317c03-d7ca-4623-93bd-15ac43797f23 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:36.553339 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-fa317c03-d7ca-4623-93bd-15ac43797f23 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1553 microversion: 2.1 time: 0.296119 May 26 12:34:36.555055 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 170/326] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:36 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1553 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:36.617762 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-15874677-0fde-4c98-a16c-ea050eb23ca2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:36.626771 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-15874677-0fde-4c98-a16c-ea050eb23ca2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.324363 May 26 12:34:36.628088 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 157/327] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:36 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:36.876092 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-1949d8ca-7ecd-4c09-87b3-13e3baa72659 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:36.876811 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-1949d8ca-7ecd-4c09-87b3-13e3baa72659 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:36.885128 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1949d8ca-7ecd-4c09-87b3-13e3baa72659 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:36.885861 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1949d8ca-7ecd-4c09-87b3-13e3baa72659 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:36.887080 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1949d8ca-7ecd-4c09-87b3-13e3baa72659 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:36.887698 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1949d8ca-7ecd-4c09-87b3-13e3baa72659 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:37.086912 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-1949d8ca-7ecd-4c09-87b3-13e3baa72659 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:37.096116 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-1949d8ca-7ecd-4c09-87b3-13e3baa72659 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.223913 May 26 12:34:37.097151 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 171/328] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:36 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:37.573389 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-9353e2c2-dae3-4447-919c-b8aba9c03071 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:37.574190 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-9353e2c2-dae3-4447-919c-b8aba9c03071 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:37.583630 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9353e2c2-dae3-4447-919c-b8aba9c03071 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:37.586159 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9353e2c2-dae3-4447-919c-b8aba9c03071 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:37.589708 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9353e2c2-dae3-4447-919c-b8aba9c03071 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:37.590374 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9353e2c2-dae3-4447-919c-b8aba9c03071 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:37.647838 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-95c5014e-42b1-4869-a016-f40ca8f6c20a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:37.649921 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-95c5014e-42b1-4869-a016-f40ca8f6c20a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:37.658369 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-95c5014e-42b1-4869-a016-f40ca8f6c20a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:37.659323 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-95c5014e-42b1-4869-a016-f40ca8f6c20a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:37.660306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-95c5014e-42b1-4869-a016-f40ca8f6c20a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:37.661036 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-95c5014e-42b1-4869-a016-f40ca8f6c20a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:37.880782 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-9353e2c2-dae3-4447-919c-b8aba9c03071 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:37.891096 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-9353e2c2-dae3-4447-919c-b8aba9c03071 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1553 microversion: 2.1 time: 0.323481 May 26 12:34:37.894137 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 158/329] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:37 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1553 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:37.918619 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-95c5014e-42b1-4869-a016-f40ca8f6c20a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:37.926517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-95c5014e-42b1-4869-a016-f40ca8f6c20a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.286103 May 26 12:34:37.937520 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 172/330] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:37 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:34:38.113422 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-72ca117e-509a-47b2-9d1e-cdf520262b95 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:38.114639 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-72ca117e-509a-47b2-9d1e-cdf520262b95 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:38.122589 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-72ca117e-509a-47b2-9d1e-cdf520262b95 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:38.123599 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-72ca117e-509a-47b2-9d1e-cdf520262b95 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:38.124991 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-72ca117e-509a-47b2-9d1e-cdf520262b95 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:38.125624 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-72ca117e-509a-47b2-9d1e-cdf520262b95 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:38.302627 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-72ca117e-509a-47b2-9d1e-cdf520262b95 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:38.325031 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-72ca117e-509a-47b2-9d1e-cdf520262b95 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.215636 May 26 12:34:38.336081 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 159/331] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:38 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:38.914472 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-22191a67-80ab-4b90-938c-b78c7162cfaf tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:38.915455 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-22191a67-80ab-4b90-938c-b78c7162cfaf tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:38.925884 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-22191a67-80ab-4b90-938c-b78c7162cfaf tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:38.927106 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-22191a67-80ab-4b90-938c-b78c7162cfaf tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:38.930902 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-22191a67-80ab-4b90-938c-b78c7162cfaf tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:38.931543 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-22191a67-80ab-4b90-938c-b78c7162cfaf tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:38.943695 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-8f3495e8-2aea-40ee-8667-edc36accd085 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:38.946637 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-8f3495e8-2aea-40ee-8667-edc36accd085 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:38.954025 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8f3495e8-2aea-40ee-8667-edc36accd085 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:38.954657 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8f3495e8-2aea-40ee-8667-edc36accd085 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:38.955937 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8f3495e8-2aea-40ee-8667-edc36accd085 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:38.956587 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8f3495e8-2aea-40ee-8667-edc36accd085 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:39.028280 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-22191a67-80ab-4b90-938c-b78c7162cfaf tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:39.036250 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-22191a67-80ab-4b90-938c-b78c7162cfaf tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1511 microversion: 2.1 time: 0.127901 May 26 12:34:39.037134 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 173/332] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:38 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1511 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:39.042281 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-0016a0ac-e555-4eb0-ae28-f62bbf3dbc49 req-8e226705-317f-4ecd-a6d8-40e814c1163b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b01a615-8fbe-4303-a8e0-6146799a92a1", "name": "network-vif-deleted", "tag": "cfb303af-9284-4763-8dc5-4ba92ee9dc4b"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:34:39.050847 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-0016a0ac-e555-4eb0-ae28-f62bbf3dbc49 req-8e226705-317f-4ecd-a6d8-40e814c1163b service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:39.051579 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-0016a0ac-e555-4eb0-ae28-f62bbf3dbc49 req-8e226705-317f-4ecd-a6d8-40e814c1163b service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:39.056510 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:39.066003 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-0016a0ac-e555-4eb0-ae28-f62bbf3dbc49 req-8e226705-317f-4ecd-a6d8-40e814c1163b service nova] Creating event network-vif-deleted:cfb303af-9284-4763-8dc5-4ba92ee9dc4b for instance 7b01a615-8fbe-4303-a8e0-6146799a92a1 on hv-cinder-81514 May 26 12:34:39.072961 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-0016a0ac-e555-4eb0-ae28-f62bbf3dbc49 req-8e226705-317f-4ecd-a6d8-40e814c1163b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033896 May 26 12:34:39.074200 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 174/333] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:34:39.130157 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-8f3495e8-2aea-40ee-8667-edc36accd085 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:39.138104 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-8f3495e8-2aea-40ee-8667-edc36accd085 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.198604 May 26 12:34:39.138849 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 160/334] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:38 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:34:39.344147 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-df3a3c3e-2e9a-461f-8b6f-1f6927ac49e4 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:39.345313 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-df3a3c3e-2e9a-461f-8b6f-1f6927ac49e4 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:39.354265 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-df3a3c3e-2e9a-461f-8b6f-1f6927ac49e4 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:39.355196 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-df3a3c3e-2e9a-461f-8b6f-1f6927ac49e4 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:39.356095 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-df3a3c3e-2e9a-461f-8b6f-1f6927ac49e4 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:39.356855 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-df3a3c3e-2e9a-461f-8b6f-1f6927ac49e4 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:39.513821 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-df3a3c3e-2e9a-461f-8b6f-1f6927ac49e4 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:39.525658 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-df3a3c3e-2e9a-461f-8b6f-1f6927ac49e4 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1313 microversion: 2.1 time: 0.182427 May 26 12:34:39.525658 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 175/335] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:39 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:40.053099 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-5b18fce1-695c-4279-b13f-01a807b8d003 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:40.053769 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-5b18fce1-695c-4279-b13f-01a807b8d003 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:40.060215 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5b18fce1-695c-4279-b13f-01a807b8d003 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:40.060663 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5b18fce1-695c-4279-b13f-01a807b8d003 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:40.061440 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5b18fce1-695c-4279-b13f-01a807b8d003 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:40.061874 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5b18fce1-695c-4279-b13f-01a807b8d003 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:40.125554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-5b18fce1-695c-4279-b13f-01a807b8d003 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:40.133528 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-5b18fce1-695c-4279-b13f-01a807b8d003 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1345 microversion: 2.1 time: 0.084227 May 26 12:34:40.134078 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 161/336] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:40 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:40.155061 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-7c56ee7c-d3da-4fc0-a77a-06e1c4e18119 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:40.155675 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-7c56ee7c-d3da-4fc0-a77a-06e1c4e18119 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:40.161817 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7c56ee7c-d3da-4fc0-a77a-06e1c4e18119 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:40.162258 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7c56ee7c-d3da-4fc0-a77a-06e1c4e18119 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:40.163804 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7c56ee7c-d3da-4fc0-a77a-06e1c4e18119 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:40.164262 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7c56ee7c-d3da-4fc0-a77a-06e1c4e18119 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:40.289900 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-7c56ee7c-d3da-4fc0-a77a-06e1c4e18119 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:40.297325 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-7c56ee7c-d3da-4fc0-a77a-06e1c4e18119 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.146190 May 26 12:34:40.297885 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 176/337] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:40 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:40.539479 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-5415badd-8e1c-4e81-84ad-2de1a6ce241c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:40.540144 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-5415badd-8e1c-4e81-84ad-2de1a6ce241c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:40.546098 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5415badd-8e1c-4e81-84ad-2de1a6ce241c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:40.546547 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5415badd-8e1c-4e81-84ad-2de1a6ce241c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:40.547310 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5415badd-8e1c-4e81-84ad-2de1a6ce241c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:40.547749 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5415badd-8e1c-4e81-84ad-2de1a6ce241c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:40.691144 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-5415badd-8e1c-4e81-84ad-2de1a6ce241c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:40.701726 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-5415badd-8e1c-4e81-84ad-2de1a6ce241c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1496 microversion: 2.1 time: 0.166324 May 26 12:34:40.702384 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 162/338] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:40 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1496 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:41.151459 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-5a81fbb0-e0af-4aee-b375-23e8b9e88773 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:41.152084 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-5a81fbb0-e0af-4aee-b375-23e8b9e88773 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:41.158753 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5a81fbb0-e0af-4aee-b375-23e8b9e88773 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:41.159302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5a81fbb0-e0af-4aee-b375-23e8b9e88773 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:41.160029 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5a81fbb0-e0af-4aee-b375-23e8b9e88773 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:41.160477 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5a81fbb0-e0af-4aee-b375-23e8b9e88773 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:41.196793 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5a81fbb0-e0af-4aee-b375-23e8b9e88773 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:41.197487 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5a81fbb0-e0af-4aee-b375-23e8b9e88773 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:41.198116 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.objects.instance [None req-5a81fbb0-e0af-4aee-b375-23e8b9e88773 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lazy-loading 'fault' on Instance uuid 7b01a615-8fbe-4303-a8e0-6146799a92a1 {{(pid=124133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:34:41.247165 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-5a81fbb0-e0af-4aee-b375-23e8b9e88773 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900271d533084386b3d7a3072c355e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7143cd05e47434a9e4babd66167f5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:41.255881 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-5a81fbb0-e0af-4aee-b375-23e8b9e88773 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 200 len: 1350 microversion: 2.1 time: 0.109107 May 26 12:34:41.260977 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 177/339] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:41 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 1350 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:41.314327 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b4c15afd-9e69-45a7-a632-03d9217991d6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:41.314866 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b4c15afd-9e69-45a7-a632-03d9217991d6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:41.322462 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b4c15afd-9e69-45a7-a632-03d9217991d6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:41.322997 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b4c15afd-9e69-45a7-a632-03d9217991d6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:41.323864 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b4c15afd-9e69-45a7-a632-03d9217991d6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:41.324368 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b4c15afd-9e69-45a7-a632-03d9217991d6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:41.457115 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b4c15afd-9e69-45a7-a632-03d9217991d6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:41.465169 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b4c15afd-9e69-45a7-a632-03d9217991d6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.154730 May 26 12:34:41.465733 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 163/340] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:41 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:42.017736 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d794719b-369b-42ac-afe0-315d591f63e0 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:42.018363 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d794719b-369b-42ac-afe0-315d591f63e0 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:42.025685 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d794719b-369b-42ac-afe0-315d591f63e0 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:42.026428 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d794719b-369b-42ac-afe0-315d591f63e0 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:42.027690 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d794719b-369b-42ac-afe0-315d591f63e0 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:42.028178 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d794719b-369b-42ac-afe0-315d591f63e0 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:42.057888 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d794719b-369b-42ac-afe0-315d591f63e0 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Going to try to terminate instance {{(pid=124133) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:34:42.158868 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-d794719b-369b-42ac-afe0-315d591f63e0 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 204 len: 0 microversion: 2.1 time: 0.144271 May 26 12:34:42.159807 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 178/341] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:34:42 2022] DELETE /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:34:42.168666 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-4c8eae5a-b126-41d8-8f62-f07f188f54b5 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:42.169432 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-4c8eae5a-b126-41d8-8f62-f07f188f54b5 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:42.175644 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4c8eae5a-b126-41d8-8f62-f07f188f54b5 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:42.176108 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4c8eae5a-b126-41d8-8f62-f07f188f54b5 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:42.176912 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4c8eae5a-b126-41d8-8f62-f07f188f54b5 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:42.177773 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4c8eae5a-b126-41d8-8f62-f07f188f54b5 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:42.275400 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-464ab96a-1345-486f-b783-cfa6cc0cca46 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:42.276115 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-464ab96a-1345-486f-b783-cfa6cc0cca46 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:42.284193 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-464ab96a-1345-486f-b783-cfa6cc0cca46 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:42.284919 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-464ab96a-1345-486f-b783-cfa6cc0cca46 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:42.285959 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-464ab96a-1345-486f-b783-cfa6cc0cca46 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:42.286666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-464ab96a-1345-486f-b783-cfa6cc0cca46 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:42.331100 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-464ab96a-1345-486f-b783-cfa6cc0cca46 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] HTTP exception thrown: Instance 7b01a615-8fbe-4303-a8e0-6146799a92a1 could not be found. May 26 12:34:42.338806 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-464ab96a-1345-486f-b783-cfa6cc0cca46 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Request method failure captured: May 26 12:34:42.338806 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 HTTP/1.1 May 26 12:34:42.338806 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:34:42.338806 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:34:42.338806 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:34:42.338806 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:34:42.338806 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:34:42.338806 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:34:42.338806 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:34:42.338806 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:34:42.338806 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3NYDPN5hmC0fpRGTzZOr12JtjMjUBZCZbgmUiQfL4Fhvy95Car7-WRkvJDpdmV1Dh68wahVT7rzlV9emVHLBLDHYKDFot29SQc8yweBopQbKDRCWambocgww9B3U9glKB9W827ZTNOejfnUP1fQa96CDrDL1qglLKcu2LoCpzEjRzQ May 26 12:34:42.338806 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:34:42.338806 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:34:42.338806 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:34:42.338806 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:34:42.338806 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:34:42.338806 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:34:42.338806 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: e7143cd05e47434a9e4babd66167f5ea May 26 12:34:42.338806 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-DeleteServersTestJSON-2095226900 May 26 12:34:42.338806 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:34:42.338806 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:34:42.341237 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e7143cd05e47434a9e4babd66167f5ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e7143cd05e47434a9e4babd66167f5ea", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e7143cd05e47434a9e4babd66167f5ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e7143cd05e47434a9e4babd66167f5ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:34:42.341237 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-DeleteServersTestJSON-2095226900 May 26 12:34:42.341237 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: e7143cd05e47434a9e4babd66167f5ea May 26 12:34:42.341237 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-DeleteServersTestJSON-2095226900 May 26 12:34:42.341237 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-DeleteServersTestJSON-2095226900-project May 26 12:34:42.341237 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:34:42.341237 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:34:42.341237 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: 900271d533084386b3d7a3072c355e4c May 26 12:34:42.341237 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-DeleteServersTestJSON-2095226900-project May 26 12:34:42.341237 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: > May 26 12:34:42.341237 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Instance 7b01a615-8fbe-4303-a8e0-6146799a92a1 could not be found. May 26 12:34:42.341237 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': '7b01a615-8fbe-4303-a8e0-6146799a92a1'} May 26 12:34:42.342094 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:34:42.342094 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:34:42.342094 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:34:42.342094 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:34:42.342094 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:34:42.342094 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:34:42.342094 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:34:42.342094 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:34:42.342094 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:34:42.342094 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:34:42.342094 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b01a615-8fbe-4303-a8e0-6146799a92a1 could not be found. May 26 12:34:42.342094 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:34:42.342094 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:34:42.342094 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:34:42.342094 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:34:42.342094 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:34:42.342094 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:34:42.342094 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:34:42.342094 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:34:42.342094 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:34:42.343496 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:34:42.343496 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:34:42.343496 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:34:42.343496 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:34:42.343496 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:34:42.343496 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:34:42.343496 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:34:42.343496 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b01a615-8fbe-4303-a8e0-6146799a92a1 could not be found. May 26 12:34:42.343496 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:34:42.343496 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:34:42.343496 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:34:42.343496 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:34:42.343496 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:34:42.343496 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:34:42.343496 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:34:42.343496 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:34:42.343496 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b01a615-8fbe-4303-a8e0-6146799a92a1 could not be found. May 26 12:34:42.343496 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:34:42.346380 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-464ab96a-1345-486f-b783-cfa6cc0cca46 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Returning 404 to user: Instance 7b01a615-8fbe-4303-a8e0-6146799a92a1 could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:34:42.348081 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-464ab96a-1345-486f-b783-cfa6cc0cca46 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 404 len: 111 microversion: 2.1 time: 0.077994 May 26 12:34:42.348826 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 179/342] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:42 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:34:42.360012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-4c8eae5a-b126-41d8-8f62-f07f188f54b5 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:42.371362 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-4c8eae5a-b126-41d8-8f62-f07f188f54b5 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1502 microversion: 2.1 time: 0.206752 May 26 12:34:42.390016 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 164/343] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:42 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1502 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:42.483958 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-58827cb6-36c7-4953-81bf-69655e199a91 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:42.484907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-58827cb6-36c7-4953-81bf-69655e199a91 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:42.504731 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-c1ac3515-7864-48ad-86dc-b0ec2f75b789 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:42.505886 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-c1ac3515-7864-48ad-86dc-b0ec2f75b789 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:42.507861 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-58827cb6-36c7-4953-81bf-69655e199a91 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:42.508649 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-58827cb6-36c7-4953-81bf-69655e199a91 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:42.509575 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-58827cb6-36c7-4953-81bf-69655e199a91 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:42.510147 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-58827cb6-36c7-4953-81bf-69655e199a91 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:42.514281 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c1ac3515-7864-48ad-86dc-b0ec2f75b789 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:42.514870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c1ac3515-7864-48ad-86dc-b0ec2f75b789 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:42.515999 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c1ac3515-7864-48ad-86dc-b0ec2f75b789 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:42.516446 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c1ac3515-7864-48ad-86dc-b0ec2f75b789 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:42.530088 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.wsgi [None req-c1ac3515-7864-48ad-86dc-b0ec2f75b789 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] HTTP exception thrown: Instance 7b01a615-8fbe-4303-a8e0-6146799a92a1 could not be found. May 26 12:34:42.534890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-c1ac3515-7864-48ad-86dc-b0ec2f75b789 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Request method failure captured: May 26 12:34:42.534890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: request: GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1/os-volume_attachments HTTP/1.1 May 26 12:34:42.534890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept: application/json May 26 12:34:42.534890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept-Encoding: identity May 26 12:34:42.534890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Connection: close May 26 12:34:42.534890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Length: 0 May 26 12:34:42.534890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Type: application/json May 26 12:34:42.534890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Host: 10.222.0.39 May 26 12:34:42.534890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Openstack-System-Scope: None May 26 12:34:42.534890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: User-Agent: python-urllib3/1.26.9 May 26 12:34:42.534890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Auth-Token: gAAAAABij3NYDPN5hmC0fpRGTzZOr12JtjMjUBZCZbgmUiQfL4Fhvy95Car7-WRkvJDpdmV1Dh68wahVT7rzlV9emVHLBLDHYKDFot29SQc8yweBopQbKDRCWambocgww9B3U9glKB9W827ZTNOejfnUP1fQa96CDrDL1qglLKcu2LoCpzEjRzQ May 26 12:34:42.534890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Id: None May 26 12:34:42.534890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Name: None May 26 12:34:42.534890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Identity-Status: Confirmed May 26 12:34:42.534890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Is-Admin-Project: True May 26 12:34:42.534890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Id: default May 26 12:34:42.534890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Name: Default May 26 12:34:42.534890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Id: e7143cd05e47434a9e4babd66167f5ea May 26 12:34:42.534890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Name: tempest-DeleteServersTestJSON-2095226900 May 26 12:34:42.534890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Role: member,reader May 26 12:34:42.534890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Roles: member,reader May 26 12:34:42.536081 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e7143cd05e47434a9e4babd66167f5ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e7143cd05e47434a9e4babd66167f5ea", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e7143cd05e47434a9e4babd66167f5ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e7143cd05e47434a9e4babd66167f5ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:34:42.536081 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant: tempest-DeleteServersTestJSON-2095226900 May 26 12:34:42.536081 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Id: e7143cd05e47434a9e4babd66167f5ea May 26 12:34:42.536081 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Name: tempest-DeleteServersTestJSON-2095226900 May 26 12:34:42.536081 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User: tempest-DeleteServersTestJSON-2095226900-project May 26 12:34:42.536081 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Id: default May 26 12:34:42.536081 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Name: Default May 26 12:34:42.536081 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Id: 900271d533084386b3d7a3072c355e4c May 26 12:34:42.536081 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Name: tempest-DeleteServersTestJSON-2095226900-project May 26 12:34:42.536081 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: method: > May 26 12:34:42.536081 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: exception: Instance 7b01a615-8fbe-4303-a8e0-6146799a92a1 could not be found. May 26 12:34:42.536081 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: action_args: {'server_id': '7b01a615-8fbe-4303-a8e0-6146799a92a1'} May 26 12:34:42.536787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:34:42.536787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:34:42.536787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:34:42.536787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:34:42.536787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:34:42.536787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:34:42.536787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:34:42.536787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:34:42.536787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:34:42.536787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:34:42.536787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b01a615-8fbe-4303-a8e0-6146799a92a1 could not be found. May 26 12:34:42.536787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:34:42.536787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:34:42.536787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:34:42.536787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:34:42.536787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:34:42.536787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:34:42.536787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:34:42.536787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:34:42.536787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:34:42.541540 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:34:42.541540 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 12:34:42.541540 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:34:42.541540 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 12:34:42.541540 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:34:42.541540 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 26 12:34:42.541540 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 26 12:34:42.541540 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:34:42.541540 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:34:42.541540 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b01a615-8fbe-4303-a8e0-6146799a92a1 could not be found. May 26 12:34:42.541540 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:34:42.541540 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:34:42.541540 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:34:42.541540 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:34:42.541540 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:34:42.541540 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:34:42.541540 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:34:42.541540 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:34:42.541540 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b01a615-8fbe-4303-a8e0-6146799a92a1 could not be found. May 26 12:34:42.541540 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:34:42.542737 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-c1ac3515-7864-48ad-86dc-b0ec2f75b789 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Returning 404 to user: Instance 7b01a615-8fbe-4303-a8e0-6146799a92a1 could not be found. {{(pid=124134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:34:42.542737 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-c1ac3515-7864-48ad-86dc-b0ec2f75b789 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035860 May 26 12:34:42.542737 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 165/344] 10.222.0.39 () {58 vars in 1301 bytes} [Thu May 26 12:34:42 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:34:42.670926 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-58827cb6-36c7-4953-81bf-69655e199a91 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:42.681727 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-58827cb6-36c7-4953-81bf-69655e199a91 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.202879 May 26 12:34:42.682307 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 180/345] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:42 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:43.398762 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-98761f74-db06-4ef1-8920-e6a7fda64046 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:43.399474 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-98761f74-db06-4ef1-8920-e6a7fda64046 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:43.405824 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-98761f74-db06-4ef1-8920-e6a7fda64046 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:43.406248 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-98761f74-db06-4ef1-8920-e6a7fda64046 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:43.407016 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-98761f74-db06-4ef1-8920-e6a7fda64046 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:43.409773 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-98761f74-db06-4ef1-8920-e6a7fda64046 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:43.570125 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-98761f74-db06-4ef1-8920-e6a7fda64046 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:43.577545 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-98761f74-db06-4ef1-8920-e6a7fda64046 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1502 microversion: 2.1 time: 0.183170 May 26 12:34:43.578104 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 166/346] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:43 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1502 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:43.698858 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-82a285dd-c4cd-4a7c-99e9-7ea11e501bbe tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:43.699490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-82a285dd-c4cd-4a7c-99e9-7ea11e501bbe tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:43.705542 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-82a285dd-c4cd-4a7c-99e9-7ea11e501bbe tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:43.706106 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-82a285dd-c4cd-4a7c-99e9-7ea11e501bbe tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:43.707076 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-82a285dd-c4cd-4a7c-99e9-7ea11e501bbe tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:43.707525 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-82a285dd-c4cd-4a7c-99e9-7ea11e501bbe tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:43.843270 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-82a285dd-c4cd-4a7c-99e9-7ea11e501bbe tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:43.851802 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-82a285dd-c4cd-4a7c-99e9-7ea11e501bbe tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.157039 May 26 12:34:43.852495 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 181/347] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:43 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:34:44.601217 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b8e24be3-3eef-4642-b246-0ea4d02dfe92 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:44.601972 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b8e24be3-3eef-4642-b246-0ea4d02dfe92 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:44.614824 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b8e24be3-3eef-4642-b246-0ea4d02dfe92 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:44.615594 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b8e24be3-3eef-4642-b246-0ea4d02dfe92 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:44.617355 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b8e24be3-3eef-4642-b246-0ea4d02dfe92 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:44.617802 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b8e24be3-3eef-4642-b246-0ea4d02dfe92 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:44.819062 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-97c2f03b-dd22-4b9d-b9eb-4940390e25b0 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:44.820252 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-97c2f03b-dd22-4b9d-b9eb-4940390e25b0 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:44.826352 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-97c2f03b-dd22-4b9d-b9eb-4940390e25b0 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:44.826881 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-97c2f03b-dd22-4b9d-b9eb-4940390e25b0 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:44.828154 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-97c2f03b-dd22-4b9d-b9eb-4940390e25b0 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:44.828677 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-97c2f03b-dd22-4b9d-b9eb-4940390e25b0 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:44.843907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-97c2f03b-dd22-4b9d-b9eb-4940390e25b0 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] HTTP exception thrown: Instance 7b01a615-8fbe-4303-a8e0-6146799a92a1 could not be found. May 26 12:34:44.845517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-97c2f03b-dd22-4b9d-b9eb-4940390e25b0 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Request method failure captured: May 26 12:34:44.845517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: DELETE /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 HTTP/1.1 May 26 12:34:44.845517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:34:44.845517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:34:44.845517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:34:44.845517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:34:44.845517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:34:44.845517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:34:44.845517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:34:44.845517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:34:44.845517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3NYDPN5hmC0fpRGTzZOr12JtjMjUBZCZbgmUiQfL4Fhvy95Car7-WRkvJDpdmV1Dh68wahVT7rzlV9emVHLBLDHYKDFot29SQc8yweBopQbKDRCWambocgww9B3U9glKB9W827ZTNOejfnUP1fQa96CDrDL1qglLKcu2LoCpzEjRzQ May 26 12:34:44.845517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:34:44.845517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:34:44.845517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:34:44.845517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:34:44.845517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:34:44.845517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:34:44.845517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: e7143cd05e47434a9e4babd66167f5ea May 26 12:34:44.845517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-DeleteServersTestJSON-2095226900 May 26 12:34:44.845517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:34:44.845517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:34:44.846688 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e7143cd05e47434a9e4babd66167f5ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e7143cd05e47434a9e4babd66167f5ea", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e7143cd05e47434a9e4babd66167f5ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e7143cd05e47434a9e4babd66167f5ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:34:44.846688 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-DeleteServersTestJSON-2095226900 May 26 12:34:44.846688 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: e7143cd05e47434a9e4babd66167f5ea May 26 12:34:44.846688 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-DeleteServersTestJSON-2095226900 May 26 12:34:44.846688 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-DeleteServersTestJSON-2095226900-project May 26 12:34:44.846688 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:34:44.846688 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:34:44.846688 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: 900271d533084386b3d7a3072c355e4c May 26 12:34:44.846688 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-DeleteServersTestJSON-2095226900-project May 26 12:34:44.846688 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: > May 26 12:34:44.846688 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Instance 7b01a615-8fbe-4303-a8e0-6146799a92a1 could not be found. May 26 12:34:44.846688 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': '7b01a615-8fbe-4303-a8e0-6146799a92a1'} May 26 12:34:44.847425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:34:44.847425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:34:44.847425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:34:44.847425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:34:44.847425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:34:44.847425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:34:44.847425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:34:44.847425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:34:44.847425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:34:44.847425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:34:44.847425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b01a615-8fbe-4303-a8e0-6146799a92a1 could not be found. May 26 12:34:44.847425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:34:44.847425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:34:44.847425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:34:44.847425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:34:44.847425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:34:44.847425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:34:44.847425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:34:44.847425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:34:44.847425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:34:44.848490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:34:44.848490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:34:44.848490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:34:44.848490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:34:44.848490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:34:44.848490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:34:44.848490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:34:44.848490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:34:44.848490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:34:44.848490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b01a615-8fbe-4303-a8e0-6146799a92a1 could not be found. May 26 12:34:44.848490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:34:44.848490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:34:44.848490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:34:44.848490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:34:44.848490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:34:44.848490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:34:44.848490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:34:44.848490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:34:44.848490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b01a615-8fbe-4303-a8e0-6146799a92a1 could not be found. May 26 12:34:44.848490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:34:44.851082 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-97c2f03b-dd22-4b9d-b9eb-4940390e25b0 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Returning 404 to user: Instance 7b01a615-8fbe-4303-a8e0-6146799a92a1 could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:34:44.851082 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-97c2f03b-dd22-4b9d-b9eb-4940390e25b0 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 404 len: 111 microversion: 2.1 time: 0.031697 May 26 12:34:44.851082 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 182/348] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:34:44 2022] DELETE /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:34:44.857748 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-61c385e4-79df-46b0-a2c4-b02636a49663 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:44.858573 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-61c385e4-79df-46b0-a2c4-b02636a49663 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] [instance: 7b01a615-8fbe-4303-a8e0-6146799a92a1] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:44.867046 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-61c385e4-79df-46b0-a2c4-b02636a49663 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:44.868337 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-61c385e4-79df-46b0-a2c4-b02636a49663 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:44.869383 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-61c385e4-79df-46b0-a2c4-b02636a49663 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:44.870458 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-61c385e4-79df-46b0-a2c4-b02636a49663 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:44.882686 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b8e24be3-3eef-4642-b246-0ea4d02dfe92 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:44.893592 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b8e24be3-3eef-4642-b246-0ea4d02dfe92 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 200 len: 1460 microversion: 2.1 time: 0.297276 May 26 12:34:44.894598 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 167/349] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:44 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 1460 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:44.903747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-61c385e4-79df-46b0-a2c4-b02636a49663 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] HTTP exception thrown: Instance 7b01a615-8fbe-4303-a8e0-6146799a92a1 could not be found. May 26 12:34:44.903747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-61c385e4-79df-46b0-a2c4-b02636a49663 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Request method failure captured: May 26 12:34:44.903747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 HTTP/1.1 May 26 12:34:44.903747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:34:44.903747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:34:44.903747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:34:44.903747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:34:44.903747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:34:44.903747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:34:44.903747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:34:44.903747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:34:44.903747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3NYDPN5hmC0fpRGTzZOr12JtjMjUBZCZbgmUiQfL4Fhvy95Car7-WRkvJDpdmV1Dh68wahVT7rzlV9emVHLBLDHYKDFot29SQc8yweBopQbKDRCWambocgww9B3U9glKB9W827ZTNOejfnUP1fQa96CDrDL1qglLKcu2LoCpzEjRzQ May 26 12:34:44.903747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:34:44.903747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:34:44.903747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:34:44.903747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:34:44.903747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:34:44.903747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:34:44.903747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: e7143cd05e47434a9e4babd66167f5ea May 26 12:34:44.903747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-DeleteServersTestJSON-2095226900 May 26 12:34:44.903747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:34:44.903747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:34:44.904968 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e7143cd05e47434a9e4babd66167f5ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e7143cd05e47434a9e4babd66167f5ea", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e7143cd05e47434a9e4babd66167f5ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e7143cd05e47434a9e4babd66167f5ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:34:44.904968 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-DeleteServersTestJSON-2095226900 May 26 12:34:44.904968 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: e7143cd05e47434a9e4babd66167f5ea May 26 12:34:44.904968 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-DeleteServersTestJSON-2095226900 May 26 12:34:44.904968 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-DeleteServersTestJSON-2095226900-project May 26 12:34:44.904968 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:34:44.904968 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:34:44.904968 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: 900271d533084386b3d7a3072c355e4c May 26 12:34:44.904968 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-DeleteServersTestJSON-2095226900-project May 26 12:34:44.904968 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: > May 26 12:34:44.904968 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Instance 7b01a615-8fbe-4303-a8e0-6146799a92a1 could not be found. May 26 12:34:44.904968 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': '7b01a615-8fbe-4303-a8e0-6146799a92a1'} May 26 12:34:44.906306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:34:44.906306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:34:44.906306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:34:44.906306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:34:44.906306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:34:44.906306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:34:44.906306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:34:44.906306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:34:44.906306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:34:44.906306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:34:44.906306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b01a615-8fbe-4303-a8e0-6146799a92a1 could not be found. May 26 12:34:44.906306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:34:44.906306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:34:44.906306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:34:44.906306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:34:44.906306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:34:44.906306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:34:44.906306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:34:44.906306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:34:44.906306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:34:44.907537 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:34:44.907537 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:34:44.907537 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:34:44.907537 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:34:44.907537 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:34:44.907537 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:34:44.907537 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:34:44.907537 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b01a615-8fbe-4303-a8e0-6146799a92a1 could not be found. May 26 12:34:44.907537 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:34:44.907537 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:34:44.907537 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:34:44.907537 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:34:44.907537 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:34:44.907537 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:34:44.907537 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:34:44.907537 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:34:44.907537 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b01a615-8fbe-4303-a8e0-6146799a92a1 could not be found. May 26 12:34:44.907537 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:34:44.908632 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-61c385e4-79df-46b0-a2c4-b02636a49663 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] Returning 404 to user: Instance 7b01a615-8fbe-4303-a8e0-6146799a92a1 could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:34:44.908632 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-61c385e4-79df-46b0-a2c4-b02636a49663 tempest-DeleteServersTestJSON-2095226900 tempest-DeleteServersTestJSON-2095226900-project] 10.222.0.39 "GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1" status: 404 len: 111 microversion: 2.1 time: 0.046150 May 26 12:34:44.909453 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-eb6f9396-3855-4020-aa70-67ba86401ef3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:44.909453 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-eb6f9396-3855-4020-aa70-67ba86401ef3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:44.909720 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 183/350] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:44 2022] GET /compute/v2.1/servers/7b01a615-8fbe-4303-a8e0-6146799a92a1 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:34:44.910444 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-dc92ebca-7e6d-43b7-95c7-40d4dfc905fc req-87858a6c-8398-493f-bff2-bc0aeb33f3fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7537224-8613-46e8-87db-0b559643c4a8", "name": "network-vif-deleted", "tag": "dce540cd-4f61-4a97-acbe-502a1728d37c"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:34:44.914631 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-eb6f9396-3855-4020-aa70-67ba86401ef3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:44.915779 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-eb6f9396-3855-4020-aa70-67ba86401ef3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:44.916946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-eb6f9396-3855-4020-aa70-67ba86401ef3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:44.917736 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-eb6f9396-3855-4020-aa70-67ba86401ef3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:44.919282 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-dc92ebca-7e6d-43b7-95c7-40d4dfc905fc req-87858a6c-8398-493f-bff2-bc0aeb33f3fc service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:44.919722 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-dc92ebca-7e6d-43b7-95c7-40d4dfc905fc req-87858a6c-8398-493f-bff2-bc0aeb33f3fc service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:44.941568 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-dc92ebca-7e6d-43b7-95c7-40d4dfc905fc req-87858a6c-8398-493f-bff2-bc0aeb33f3fc service nova] Creating event network-vif-deleted:dce540cd-4f61-4a97-acbe-502a1728d37c for instance c7537224-8613-46e8-87db-0b559643c4a8 on hv-cinder-81514 May 26 12:34:44.951135 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-dc92ebca-7e6d-43b7-95c7-40d4dfc905fc req-87858a6c-8398-493f-bff2-bc0aeb33f3fc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045966 May 26 12:34:44.951755 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 184/351] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:34:45.140328 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-eb6f9396-3855-4020-aa70-67ba86401ef3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:45.152537 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-eb6f9396-3855-4020-aa70-67ba86401ef3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.256625 May 26 12:34:45.153428 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 168/352] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:44 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:45.241482 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-33519488-e83c-4015-8507-f31203b24053 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1419263323", "imageRef": "7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4", "flavorRef": "452"}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:34:45.299512 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.network.neutron [None req-33519488-e83c-4015-8507-f31203b24053 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] validate_networks() for None {{(pid=124133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:34:45.626796 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-33519488-e83c-4015-8507-f31203b24053 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Flavor limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:34:45.627438 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-33519488-e83c-4015-8507-f31203b24053 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Image limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:34:45.627945 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-33519488-e83c-4015-8507-f31203b24053 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Flavor pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:34:45.628356 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-33519488-e83c-4015-8507-f31203b24053 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Image pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:34:45.628797 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-33519488-e83c-4015-8507-f31203b24053 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:34:45.638529 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-33519488-e83c-4015-8507-f31203b24053 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:45.638966 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-33519488-e83c-4015-8507-f31203b24053 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:45.639826 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-33519488-e83c-4015-8507-f31203b24053 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:45.640296 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-33519488-e83c-4015-8507-f31203b24053 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:45.658567 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-33519488-e83c-4015-8507-f31203b24053 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Getting quotas for project 783419b36f6d446ba0f1ff249bbaea5a. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:34:45.662852 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-33519488-e83c-4015-8507-f31203b24053 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Getting quotas for user 9ed76893bbb4445b9d1455254d7120c4 and project 783419b36f6d446ba0f1ff249bbaea5a. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:34:45.675683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-33519488-e83c-4015-8507-f31203b24053 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Going to run 1 instances... {{(pid=124133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:34:45.678147 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-33519488-e83c-4015-8507-f31203b24053 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:34:45.743250 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-33519488-e83c-4015-8507-f31203b24053 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.507347 May 26 12:34:45.749114 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 185/353] 10.222.0.39 () {60 vars in 1146 bytes} [Thu May 26 12:34:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:34:45.755306 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-bd3b1e2b-6e7b-40d2-9da7-ac575c3021aa tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:45.757261 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-bd3b1e2b-6e7b-40d2-9da7-ac575c3021aa tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:45.866480 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-bd3b1e2b-6e7b-40d2-9da7-ac575c3021aa tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:45.874564 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-bd3b1e2b-6e7b-40d2-9da7-ac575c3021aa tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1215 microversion: 2.1 time: 0.123984 May 26 12:34:45.882562 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 169/354] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:45 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1215 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:45.911813 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-bdd80693-d76c-498c-8360-d5c55b4d6817 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:45.914106 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-bdd80693-d76c-498c-8360-d5c55b4d6817 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: c7537224-8613-46e8-87db-0b559643c4a8] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:45.915999 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:45.926000 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bdd80693-d76c-498c-8360-d5c55b4d6817 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:45.926415 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bdd80693-d76c-498c-8360-d5c55b4d6817 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:45.927169 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bdd80693-d76c-498c-8360-d5c55b4d6817 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:45.927611 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bdd80693-d76c-498c-8360-d5c55b4d6817 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:45.963260 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-bdd80693-d76c-498c-8360-d5c55b4d6817 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] HTTP exception thrown: Instance c7537224-8613-46e8-87db-0b559643c4a8 could not be found. May 26 12:34:45.965135 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-bdd80693-d76c-498c-8360-d5c55b4d6817 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Request method failure captured: May 26 12:34:45.965135 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 HTTP/1.1 May 26 12:34:45.965135 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:34:45.965135 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:34:45.965135 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:34:45.965135 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:34:45.965135 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:34:45.965135 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:34:45.965135 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:34:45.965135 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:34:45.965135 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3OH9knx94-78d8W9X4QCeYg6L1EzZ1oDg-vNvI5HC1WU140YvV7BYtbCe3JcAGk20AahnhTTZV0-HcdUNWI2busM1nfz-wRAEeb8XiMKFHE8D0P-jaoG5PNV0qitlOt066md6wGkSPX8bKiNp7e9K40WUbvjVko1_AZ7HX500pTxMg May 26 12:34:45.965135 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:34:45.965135 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:34:45.965135 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:34:45.965135 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:34:45.965135 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:34:45.965135 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:34:45.965135 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: 1262e1a887bf44b0ae7fa8ac522e1250 May 26 12:34:45.965135 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-VolumesActionsTest-484881299 May 26 12:34:45.965135 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:34:45.965135 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:34:45.966693 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1262e1a887bf44b0ae7fa8ac522e1250"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1262e1a887bf44b0ae7fa8ac522e1250", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1262e1a887bf44b0ae7fa8ac522e1250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1262e1a887bf44b0ae7fa8ac522e1250"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:34:45.966693 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-VolumesActionsTest-484881299 May 26 12:34:45.966693 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: 1262e1a887bf44b0ae7fa8ac522e1250 May 26 12:34:45.966693 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-VolumesActionsTest-484881299 May 26 12:34:45.966693 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-VolumesActionsTest-484881299-project May 26 12:34:45.966693 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:34:45.966693 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:34:45.966693 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: c30a4258c6024a7c9ef1fbd694fa9bfd May 26 12:34:45.966693 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-VolumesActionsTest-484881299-project May 26 12:34:45.966693 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: > May 26 12:34:45.966693 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Instance c7537224-8613-46e8-87db-0b559643c4a8 could not be found. May 26 12:34:45.966693 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': 'c7537224-8613-46e8-87db-0b559643c4a8'} May 26 12:34:45.967600 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:34:45.967600 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:34:45.967600 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:34:45.967600 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:34:45.967600 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:34:45.967600 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:34:45.967600 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:34:45.967600 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:34:45.967600 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:34:45.967600 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:34:45.967600 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7537224-8613-46e8-87db-0b559643c4a8 could not be found. May 26 12:34:45.967600 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:34:45.967600 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:34:45.967600 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:34:45.967600 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:34:45.967600 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:34:45.967600 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:34:45.967600 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:34:45.967600 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:34:45.967600 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:34:45.968872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:34:45.968872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:34:45.968872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:34:45.968872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:34:45.968872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:34:45.968872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:34:45.968872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:34:45.968872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7537224-8613-46e8-87db-0b559643c4a8 could not be found. May 26 12:34:45.968872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:34:45.968872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:34:45.968872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:34:45.968872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:34:45.968872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:34:45.968872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:34:45.968872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:34:45.968872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:34:45.968872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7537224-8613-46e8-87db-0b559643c4a8 could not be found. May 26 12:34:45.968872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:34:45.970003 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-bdd80693-d76c-498c-8360-d5c55b4d6817 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Returning 404 to user: Instance c7537224-8613-46e8-87db-0b559643c4a8 could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:34:45.970003 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-bdd80693-d76c-498c-8360-d5c55b4d6817 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8" status: 404 len: 111 microversion: 2.1 time: 0.058960 May 26 12:34:45.970003 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 186/355] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:45 2022] GET /compute/v2.1/servers/c7537224-8613-46e8-87db-0b559643c4a8 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:34:46.170185 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-4686b8f5-202e-45a7-addd-b26b530b2fc3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:46.170921 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-4686b8f5-202e-45a7-addd-b26b530b2fc3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:46.182440 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4686b8f5-202e-45a7-addd-b26b530b2fc3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:46.184042 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4686b8f5-202e-45a7-addd-b26b530b2fc3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:46.187829 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4686b8f5-202e-45a7-addd-b26b530b2fc3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:46.188441 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4686b8f5-202e-45a7-addd-b26b530b2fc3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:46.219601 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-692d7606-c163-4052-aa12-05eec0ecd57d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-259904514", "imageRef": "7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4", "flavorRef": "452", "networks": [{"uuid": "4723ee3b-d43b-4526-a69d-d7330ca62f75"}]}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:34:46.257517 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=100 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:46.323843 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.network.neutron [None req-692d7606-c163-4052-aa12-05eec0ecd57d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] validate_networks() for [('4723ee3b-d43b-4526-a69d-d7330ca62f75', None, None, None, None, None)] {{(pid=124133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:34:46.592929 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-4686b8f5-202e-45a7-addd-b26b530b2fc3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:46.607641 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-4686b8f5-202e-45a7-addd-b26b530b2fc3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.441770 May 26 12:34:46.612850 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 170/356] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:46 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:46.900170 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-4858bbb7-344b-4275-b69d-3220152f3874 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:46.901119 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-4858bbb7-344b-4275-b69d-3220152f3874 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:46.907752 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4858bbb7-344b-4275-b69d-3220152f3874 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:46.908465 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4858bbb7-344b-4275-b69d-3220152f3874 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:46.909767 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4858bbb7-344b-4275-b69d-3220152f3874 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:46.910666 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4858bbb7-344b-4275-b69d-3220152f3874 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:46.916173 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-692d7606-c163-4052-aa12-05eec0ecd57d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Flavor limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:34:46.916746 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-692d7606-c163-4052-aa12-05eec0ecd57d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Image limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:34:46.917122 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-692d7606-c163-4052-aa12-05eec0ecd57d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Flavor pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:34:46.917688 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-692d7606-c163-4052-aa12-05eec0ecd57d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Image pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:34:46.918108 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-692d7606-c163-4052-aa12-05eec0ecd57d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:34:46.929115 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-692d7606-c163-4052-aa12-05eec0ecd57d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:46.932332 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-692d7606-c163-4052-aa12-05eec0ecd57d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:46.932332 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-692d7606-c163-4052-aa12-05eec0ecd57d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:46.932332 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-692d7606-c163-4052-aa12-05eec0ecd57d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:46.951320 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-692d7606-c163-4052-aa12-05eec0ecd57d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Getting quotas for project 1262e1a887bf44b0ae7fa8ac522e1250. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:34:46.956237 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-692d7606-c163-4052-aa12-05eec0ecd57d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Getting quotas for user c30a4258c6024a7c9ef1fbd694fa9bfd and project 1262e1a887bf44b0ae7fa8ac522e1250. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:34:46.970106 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-692d7606-c163-4052-aa12-05eec0ecd57d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Going to run 1 instances... {{(pid=124133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:34:46.973733 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-692d7606-c163-4052-aa12-05eec0ecd57d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:34:47.004640 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-4858bbb7-344b-4275-b69d-3220152f3874 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:47.019626 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-4858bbb7-344b-4275-b69d-3220152f3874 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1267 microversion: 2.1 time: 0.124167 May 26 12:34:47.020585 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 171/357] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:46 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1267 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:34:47.042053 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-692d7606-c163-4052-aa12-05eec0ecd57d tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.826492 May 26 12:34:47.052480 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-03b6f1c7-8d72-4f5a-8be0-7d6f4bb12139 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:47.053895 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-03b6f1c7-8d72-4f5a-8be0-7d6f4bb12139 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:47.058695 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 187/358] 10.222.0.39 () {60 vars in 1146 bytes} [Thu May 26 12:34:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:34:47.164810 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-03b6f1c7-8d72-4f5a-8be0-7d6f4bb12139 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:47.174543 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-03b6f1c7-8d72-4f5a-8be0-7d6f4bb12139 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1213 microversion: 2.1 time: 0.125739 May 26 12:34:47.177201 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 172/359] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:47 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1213 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:47.625162 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f48e31be-1d08-4105-939f-6ff574ef945a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:47.625770 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f48e31be-1d08-4105-939f-6ff574ef945a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:47.642882 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f48e31be-1d08-4105-939f-6ff574ef945a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:47.643345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f48e31be-1d08-4105-939f-6ff574ef945a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:47.644958 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f48e31be-1d08-4105-939f-6ff574ef945a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:47.645302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f48e31be-1d08-4105-939f-6ff574ef945a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:48.039371 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-60accd8c-6d87-465e-a4ee-80cb0f3491b8 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:48.040139 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-60accd8c-6d87-465e-a4ee-80cb0f3491b8 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:48.048006 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-60accd8c-6d87-465e-a4ee-80cb0f3491b8 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:48.048469 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-60accd8c-6d87-465e-a4ee-80cb0f3491b8 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:48.049321 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-60accd8c-6d87-465e-a4ee-80cb0f3491b8 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:48.049762 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-60accd8c-6d87-465e-a4ee-80cb0f3491b8 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:48.051121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f48e31be-1d08-4105-939f-6ff574ef945a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:48.062827 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f48e31be-1d08-4105-939f-6ff574ef945a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.440978 May 26 12:34:48.064014 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 188/360] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:47 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:48.187400 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-60accd8c-6d87-465e-a4ee-80cb0f3491b8 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:48.195931 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-dee4fa92-6143-4139-ab56-7fdbcbaeeffb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:48.196550 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-dee4fa92-6143-4139-ab56-7fdbcbaeeffb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:48.207108 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dee4fa92-6143-4139-ab56-7fdbcbaeeffb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:48.207569 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dee4fa92-6143-4139-ab56-7fdbcbaeeffb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:48.208361 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dee4fa92-6143-4139-ab56-7fdbcbaeeffb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:48.208482 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-60accd8c-6d87-465e-a4ee-80cb0f3491b8 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1273 microversion: 2.1 time: 0.173174 May 26 12:34:48.211581 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 173/361] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:48 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1273 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:48.216932 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dee4fa92-6143-4139-ab56-7fdbcbaeeffb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:48.311326 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-dee4fa92-6143-4139-ab56-7fdbcbaeeffb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:48.322937 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-dee4fa92-6143-4139-ab56-7fdbcbaeeffb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1265 microversion: 2.1 time: 0.131694 May 26 12:34:48.323747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 189/362] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:48 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1265 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:49.080174 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-79f5af38-bc44-4a50-9c7a-02768464db44 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:49.080819 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-79f5af38-bc44-4a50-9c7a-02768464db44 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:49.087999 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-79f5af38-bc44-4a50-9c7a-02768464db44 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:49.088459 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-79f5af38-bc44-4a50-9c7a-02768464db44 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:49.089265 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-79f5af38-bc44-4a50-9c7a-02768464db44 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:49.089890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-79f5af38-bc44-4a50-9c7a-02768464db44 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:49.228609 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-3a03be37-cb53-460d-9592-5d054f0de9f3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:49.229350 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-3a03be37-cb53-460d-9592-5d054f0de9f3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:49.235442 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3a03be37-cb53-460d-9592-5d054f0de9f3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:49.235885 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3a03be37-cb53-460d-9592-5d054f0de9f3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:49.236643 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3a03be37-cb53-460d-9592-5d054f0de9f3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:49.237406 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3a03be37-cb53-460d-9592-5d054f0de9f3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:49.797506 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-79f5af38-bc44-4a50-9c7a-02768464db44 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:49.817615 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-79f5af38-bc44-4a50-9c7a-02768464db44 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.741105 May 26 12:34:49.821898 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 174/363] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:49 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:49.836064 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6f40e245-945a-441b-ad03-cae3e75bcd31 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:49.836682 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-6f40e245-945a-441b-ad03-cae3e75bcd31 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:49.849530 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6f40e245-945a-441b-ad03-cae3e75bcd31 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:49.850723 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6f40e245-945a-441b-ad03-cae3e75bcd31 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:49.851935 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6f40e245-945a-441b-ad03-cae3e75bcd31 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:49.852514 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6f40e245-945a-441b-ad03-cae3e75bcd31 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:49.932142 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-3a03be37-cb53-460d-9592-5d054f0de9f3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:49.943653 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-3a03be37-cb53-460d-9592-5d054f0de9f3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1315 microversion: 2.1 time: 0.720170 May 26 12:34:49.958058 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 190/364] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:49 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1315 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:49.989659 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-6f40e245-945a-441b-ad03-cae3e75bcd31 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:50.004639 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-6f40e245-945a-441b-ad03-cae3e75bcd31 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1271 microversion: 2.1 time: 0.179607 May 26 12:34:50.005432 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 175/365] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:49 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1271 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:50.838589 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-a74393b1-3ed6-43d7-92af-496abd858aaa tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:50.839304 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-a74393b1-3ed6-43d7-92af-496abd858aaa tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:50.851456 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a74393b1-3ed6-43d7-92af-496abd858aaa tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:50.853994 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a74393b1-3ed6-43d7-92af-496abd858aaa tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:50.855597 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a74393b1-3ed6-43d7-92af-496abd858aaa tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:50.856928 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a74393b1-3ed6-43d7-92af-496abd858aaa tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:50.964278 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-3d51b093-5a74-4f48-a28d-9ec98d446eb9 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:50.965292 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-3d51b093-5a74-4f48-a28d-9ec98d446eb9 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:50.972902 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3d51b093-5a74-4f48-a28d-9ec98d446eb9 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:50.974269 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3d51b093-5a74-4f48-a28d-9ec98d446eb9 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:50.975863 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3d51b093-5a74-4f48-a28d-9ec98d446eb9 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:50.976653 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3d51b093-5a74-4f48-a28d-9ec98d446eb9 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:51.574731 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-a74393b1-3ed6-43d7-92af-496abd858aaa tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:51.585725 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-3d51b093-5a74-4f48-a28d-9ec98d446eb9 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:51.594794 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-3d51b093-5a74-4f48-a28d-9ec98d446eb9 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1315 microversion: 2.1 time: 0.635851 May 26 12:34:51.595339 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-a74393b1-3ed6-43d7-92af-496abd858aaa tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.757362 May 26 12:34:51.606979 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 191/366] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:50 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:51.610965 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 176/367] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:50 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1315 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:51.616065 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-8e2f83c6-4b27-4c14-b437-9611beb0208d req-4af03843-b5c0-4c37-850e-577871b06bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31193401-1445-4200-b186-486852801e52", "tag": "98473f77-815b-4b93-be44-93cb7ca63380"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:34:51.618577 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-924ab761-b914-4670-836b-c6e19f1fb8e9 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:51.619358 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-924ab761-b914-4670-836b-c6e19f1fb8e9 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:51.634121 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-8e2f83c6-4b27-4c14-b437-9611beb0208d req-4af03843-b5c0-4c37-850e-577871b06bcc service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:51.635468 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-924ab761-b914-4670-836b-c6e19f1fb8e9 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:51.636093 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-924ab761-b914-4670-836b-c6e19f1fb8e9 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:51.637298 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-924ab761-b914-4670-836b-c6e19f1fb8e9 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:51.637940 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-8e2f83c6-4b27-4c14-b437-9611beb0208d req-4af03843-b5c0-4c37-850e-577871b06bcc service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:51.639791 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-924ab761-b914-4670-836b-c6e19f1fb8e9 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:51.655060 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-8e2f83c6-4b27-4c14-b437-9611beb0208d req-4af03843-b5c0-4c37-850e-577871b06bcc service nova] Creating event network-changed:98473f77-815b-4b93-be44-93cb7ca63380 for instance 31193401-1445-4200-b186-486852801e52 on hv-cinder-81514 May 26 12:34:51.681375 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-8e2f83c6-4b27-4c14-b437-9611beb0208d req-4af03843-b5c0-4c37-850e-577871b06bcc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064150 May 26 12:34:51.683462 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 177/368] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:34:51.892225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-924ab761-b914-4670-836b-c6e19f1fb8e9 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:51.903693 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-924ab761-b914-4670-836b-c6e19f1fb8e9 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1313 microversion: 2.1 time: 0.295316 May 26 12:34:51.904520 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 192/369] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:51 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:52.613565 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-30e6087e-6678-40b2-8afc-951bc0689b96 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:52.614170 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-30e6087e-6678-40b2-8afc-951bc0689b96 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:52.614473 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-9a88ce37-c7e1-4f4b-9e11-a6efb4e2b9ee tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:52.615834 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-9a88ce37-c7e1-4f4b-9e11-a6efb4e2b9ee tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:52.628522 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-30e6087e-6678-40b2-8afc-951bc0689b96 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:52.628673 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=76 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:52.629002 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-30e6087e-6678-40b2-8afc-951bc0689b96 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:52.629785 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-30e6087e-6678-40b2-8afc-951bc0689b96 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:52.630221 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-30e6087e-6678-40b2-8afc-951bc0689b96 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:52.634799 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9a88ce37-c7e1-4f4b-9e11-a6efb4e2b9ee tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:52.635264 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9a88ce37-c7e1-4f4b-9e11-a6efb4e2b9ee tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:52.636040 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9a88ce37-c7e1-4f4b-9e11-a6efb4e2b9ee tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:52.638097 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9a88ce37-c7e1-4f4b-9e11-a6efb4e2b9ee tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:53.098098 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-9a88ce37-c7e1-4f4b-9e11-a6efb4e2b9ee tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:53.108260 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-30e6087e-6678-40b2-8afc-951bc0689b96 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:53.108820 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-9a88ce37-c7e1-4f4b-9e11-a6efb4e2b9ee tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.498837 May 26 12:34:53.109247 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 178/370] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:52 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:53.116696 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-30e6087e-6678-40b2-8afc-951bc0689b96 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1315 microversion: 2.1 time: 0.506635 May 26 12:34:53.119952 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 193/371] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:52 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:53.122577 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-3ee1cef9-dbcc-4cf0-a624-bfc417865169 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:53.127531 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-3ee1cef9-dbcc-4cf0-a624-bfc417865169 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:53.136335 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3ee1cef9-dbcc-4cf0-a624-bfc417865169 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:53.137306 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3ee1cef9-dbcc-4cf0-a624-bfc417865169 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:53.138163 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3ee1cef9-dbcc-4cf0-a624-bfc417865169 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:53.138750 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3ee1cef9-dbcc-4cf0-a624-bfc417865169 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:53.319802 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-3ee1cef9-dbcc-4cf0-a624-bfc417865169 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:53.326652 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-3ee1cef9-dbcc-4cf0-a624-bfc417865169 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1313 microversion: 2.1 time: 0.212541 May 26 12:34:53.336058 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 179/372] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:53 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:53.728238 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-8892881a-1bfc-4b22-863f-7b29ef3720be req-307fa7d0-2e5a-49a6-9021-f98264082e86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50249dcb-fe40-45b9-a40e-07242ec49ca2", "tag": "66c6c832-2921-4950-a94c-a7d04e78d89d"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:34:53.737370 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-8892881a-1bfc-4b22-863f-7b29ef3720be req-307fa7d0-2e5a-49a6-9021-f98264082e86 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:53.738235 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-8892881a-1bfc-4b22-863f-7b29ef3720be req-307fa7d0-2e5a-49a6-9021-f98264082e86 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:53.753312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:53.755570 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-8892881a-1bfc-4b22-863f-7b29ef3720be req-307fa7d0-2e5a-49a6-9021-f98264082e86 service nova] Creating event network-changed:66c6c832-2921-4950-a94c-a7d04e78d89d for instance 50249dcb-fe40-45b9-a40e-07242ec49ca2 on hv-cinder-81514 May 26 12:34:53.763525 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-8892881a-1bfc-4b22-863f-7b29ef3720be req-307fa7d0-2e5a-49a6-9021-f98264082e86 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038920 May 26 12:34:53.765006 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 194/373] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:34:54.125999 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-03559636-d667-44eb-9fb9-5efb6411f5b4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:54.127464 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-03559636-d667-44eb-9fb9-5efb6411f5b4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:54.136941 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-7321b2aa-06dd-420a-ba92-1e3b127a336c tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:54.138357 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-7321b2aa-06dd-420a-ba92-1e3b127a336c tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:54.150804 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-03559636-d667-44eb-9fb9-5efb6411f5b4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:54.151959 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7321b2aa-06dd-420a-ba92-1e3b127a336c tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:54.152414 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7321b2aa-06dd-420a-ba92-1e3b127a336c tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:54.153612 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-03559636-d667-44eb-9fb9-5efb6411f5b4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:54.154219 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-03559636-d667-44eb-9fb9-5efb6411f5b4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:54.154922 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-03559636-d667-44eb-9fb9-5efb6411f5b4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:54.155699 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7321b2aa-06dd-420a-ba92-1e3b127a336c tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:54.156264 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7321b2aa-06dd-420a-ba92-1e3b127a336c tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:54.489503 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-03559636-d667-44eb-9fb9-5efb6411f5b4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:54.498696 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-7321b2aa-06dd-420a-ba92-1e3b127a336c tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:54.500212 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-03559636-d667-44eb-9fb9-5efb6411f5b4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.378335 May 26 12:34:54.505922 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 180/374] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:54 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:54.511865 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-11f0864e-35d0-41c6-a4dd-46c885aee663 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:54.513571 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-11f0864e-35d0-41c6-a4dd-46c885aee663 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:54.516382 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-7321b2aa-06dd-420a-ba92-1e3b127a336c tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1315 microversion: 2.1 time: 0.384323 May 26 12:34:54.517300 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 195/375] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:54 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:54.523972 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-11f0864e-35d0-41c6-a4dd-46c885aee663 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:54.524427 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-11f0864e-35d0-41c6-a4dd-46c885aee663 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:54.525230 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-11f0864e-35d0-41c6-a4dd-46c885aee663 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:54.525679 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-11f0864e-35d0-41c6-a4dd-46c885aee663 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:54.717660 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-11f0864e-35d0-41c6-a4dd-46c885aee663 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:54.727957 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-11f0864e-35d0-41c6-a4dd-46c885aee663 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1313 microversion: 2.1 time: 0.220168 May 26 12:34:54.728550 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 181/376] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:54 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:54.820615 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e03d833f-be98-4737-881e-3dace604094b tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Action: 'create', calling method: .version_select at 0x7fed315f21f0>, body: {"keypair": {"name": "tempest-keypair-100175735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNd0/OySFNBCzAN+MxxOLdHtW5tK/fuMWayqzJI7k+/BnTBwRgUrz2dwM/eHpqT2tX8ermdX+6FqkMrHtnvTTNOn6cgNdVEDU6LwX2muGeaxsfyJVaf23Vbs7MstKoWNYQ=="}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:34:54.837646 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-e03d833f-be98-4737-881e-3dace604094b tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Getting quotas for project 079362a77e344c61af67f7b256545329. Resources: {'key_pairs'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:34:54.842183 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-e03d833f-be98-4737-881e-3dace604094b tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Getting quotas for user 1156b006d6e1426a84a521d397491135 and project 079362a77e344c61af67f7b256545329. Resources: {'key_pairs'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:34:54.867951 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e03d833f-be98-4737-881e-3dace604094b tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.268190 May 26 12:34:54.869157 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 196/377] 10.222.0.39 () {60 vars in 1158 bytes} [Thu May 26 12:34:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:34:55.518602 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-2d345a14-2845-4293-9ecb-fd4ea96c9861 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:55.519220 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-2d345a14-2845-4293-9ecb-fd4ea96c9861 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:55.526776 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2d345a14-2845-4293-9ecb-fd4ea96c9861 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:55.527314 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2d345a14-2845-4293-9ecb-fd4ea96c9861 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:55.528163 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2d345a14-2845-4293-9ecb-fd4ea96c9861 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:55.528723 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2d345a14-2845-4293-9ecb-fd4ea96c9861 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:55.536063 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-16965729-6d6f-421f-b8f9-59415c7f45ed tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:55.536686 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-16965729-6d6f-421f-b8f9-59415c7f45ed tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:55.542741 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-16965729-6d6f-421f-b8f9-59415c7f45ed tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:55.543192 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-16965729-6d6f-421f-b8f9-59415c7f45ed tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:55.543961 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-16965729-6d6f-421f-b8f9-59415c7f45ed tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:55.544595 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-16965729-6d6f-421f-b8f9-59415c7f45ed tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:55.723799 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2d345a14-2845-4293-9ecb-fd4ea96c9861 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:55.736377 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-2d345a14-2845-4293-9ecb-fd4ea96c9861 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.221152 May 26 12:34:55.737890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 182/378] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:55 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:55.756218 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-45fb3956-30a0-4325-acfb-f5439bcaf6c2 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:55.759392 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-45fb3956-30a0-4325-acfb-f5439bcaf6c2 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:55.766718 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-45fb3956-30a0-4325-acfb-f5439bcaf6c2 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:55.767164 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-45fb3956-30a0-4325-acfb-f5439bcaf6c2 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:55.767983 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-45fb3956-30a0-4325-acfb-f5439bcaf6c2 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:55.768418 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-45fb3956-30a0-4325-acfb-f5439bcaf6c2 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:55.891597 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-16965729-6d6f-421f-b8f9-59415c7f45ed tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:55.902686 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-16965729-6d6f-421f-b8f9-59415c7f45ed tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1315 microversion: 2.1 time: 0.369427 May 26 12:34:55.903702 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 197/379] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:55 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:34:56.143982 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-45fb3956-30a0-4325-acfb-f5439bcaf6c2 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:56.153364 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-45fb3956-30a0-4325-acfb-f5439bcaf6c2 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1313 microversion: 2.1 time: 0.412551 May 26 12:34:56.164218 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 183/380] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:55 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:34:56.419337 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-fc369404-7ba2-4010-a275-bbe93c30e62c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-221236462", "imageRef": "7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5e8da0b1-ba0e-4cd0-92d2-6bbdcd16b096"}], "security_groups": [{"name": "tempest-securitygroup--71512216"}], "key_name": "tempest-keypair-100175735", "user_data": "}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:34:56.557590 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.network.neutron [None req-fc369404-7ba2-4010-a275-bbe93c30e62c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] validate_networks() for [('5e8da0b1-ba0e-4cd0-92d2-6bbdcd16b096', None, None, None, None, None)] {{(pid=124133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:34:56.756966 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-db3e96e6-10be-4eba-a46b-a1937f451c78 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:56.757689 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-db3e96e6-10be-4eba-a46b-a1937f451c78 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:56.764848 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-db3e96e6-10be-4eba-a46b-a1937f451c78 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:56.765406 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-db3e96e6-10be-4eba-a46b-a1937f451c78 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:56.766291 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-db3e96e6-10be-4eba-a46b-a1937f451c78 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:56.766835 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-db3e96e6-10be-4eba-a46b-a1937f451c78 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:56.941935 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=4 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:57.037601 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-db3e96e6-10be-4eba-a46b-a1937f451c78 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:57.056263 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-db3e96e6-10be-4eba-a46b-a1937f451c78 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.304365 May 26 12:34:57.059660 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-fc369404-7ba2-4010-a275-bbe93c30e62c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Flavor limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:34:57.060445 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-fc369404-7ba2-4010-a275-bbe93c30e62c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Image limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:34:57.061386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-fc369404-7ba2-4010-a275-bbe93c30e62c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Flavor pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:34:57.062002 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-fc369404-7ba2-4010-a275-bbe93c30e62c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Image pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:34:57.062740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-fc369404-7ba2-4010-a275-bbe93c30e62c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:34:57.065459 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 184/381] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:56 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:57.083322 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fc369404-7ba2-4010-a275-bbe93c30e62c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:57.085300 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-30a33152-3cdc-4092-8614-8c3e7b6ef0da tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:57.085613 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fc369404-7ba2-4010-a275-bbe93c30e62c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:57.086138 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-30a33152-3cdc-4092-8614-8c3e7b6ef0da tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:57.086613 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fc369404-7ba2-4010-a275-bbe93c30e62c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:57.087149 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fc369404-7ba2-4010-a275-bbe93c30e62c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:57.093982 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-30a33152-3cdc-4092-8614-8c3e7b6ef0da tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:57.094735 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-30a33152-3cdc-4092-8614-8c3e7b6ef0da tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:57.095683 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-30a33152-3cdc-4092-8614-8c3e7b6ef0da tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:57.096356 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-30a33152-3cdc-4092-8614-8c3e7b6ef0da tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:57.111960 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-fc369404-7ba2-4010-a275-bbe93c30e62c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Getting quotas for project 079362a77e344c61af67f7b256545329. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:34:57.132364 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-fc369404-7ba2-4010-a275-bbe93c30e62c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Getting quotas for user 1156b006d6e1426a84a521d397491135 and project 079362a77e344c61af67f7b256545329. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:34:57.159323 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-fc369404-7ba2-4010-a275-bbe93c30e62c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Going to run 1 instances... {{(pid=124133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:34:57.163535 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-fc369404-7ba2-4010-a275-bbe93c30e62c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:34:57.169889 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell0:SELECT=4 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:57.253543 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-fc369404-7ba2-4010-a275-bbe93c30e62c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.838456 May 26 12:34:57.254776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 198/382] 10.222.0.39 () {60 vars in 1146 bytes} [Thu May 26 12:34:56 2022] POST /compute/v2.1/servers => generated 400 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:34:57.264133 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-93cc0f4b-f6e0-40e0-bf34-ddc8762dd00a tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:57.265771 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-93cc0f4b-f6e0-40e0-bf34-ddc8762dd00a tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:57.275002 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-93cc0f4b-f6e0-40e0-bf34-ddc8762dd00a tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:57.275866 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-93cc0f4b-f6e0-40e0-bf34-ddc8762dd00a tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:57.277372 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-93cc0f4b-f6e0-40e0-bf34-ddc8762dd00a tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:57.277979 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-93cc0f4b-f6e0-40e0-bf34-ddc8762dd00a tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:57.488335 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-30a33152-3cdc-4092-8614-8c3e7b6ef0da tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:57.515155 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-30a33152-3cdc-4092-8614-8c3e7b6ef0da tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1315 microversion: 2.1 time: 0.423888 May 26 12:34:57.518171 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 185/383] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:57 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:57.559116 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-71fa9b1a-1a86-4e85-a728-b83f0fa3a1be tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:57.566795 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-71fa9b1a-1a86-4e85-a728-b83f0fa3a1be tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:57.782386 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-71fa9b1a-1a86-4e85-a728-b83f0fa3a1be tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:57.795367 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-71fa9b1a-1a86-4e85-a728-b83f0fa3a1be tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1236 microversion: 2.1 time: 0.275574 May 26 12:34:57.805094 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 186/384] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:57 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1236 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:57.805828 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-93cc0f4b-f6e0-40e0-bf34-ddc8762dd00a tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:57.816426 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-93cc0f4b-f6e0-40e0-bf34-ddc8762dd00a tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1313 microversion: 2.1 time: 0.560243 May 26 12:34:57.824771 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 199/385] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:57 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1313 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:58.082717 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-ae494044-7ae0-4b83-80da-fc6008dd8712 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:58.083726 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-ae494044-7ae0-4b83-80da-fc6008dd8712 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:58.091495 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ae494044-7ae0-4b83-80da-fc6008dd8712 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:58.092030 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ae494044-7ae0-4b83-80da-fc6008dd8712 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:58.092985 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ae494044-7ae0-4b83-80da-fc6008dd8712 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:58.093425 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ae494044-7ae0-4b83-80da-fc6008dd8712 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:58.236785 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ae494044-7ae0-4b83-80da-fc6008dd8712 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:58.245116 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-ae494044-7ae0-4b83-80da-fc6008dd8712 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.166380 May 26 12:34:58.246089 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 187/386] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:58 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:58.535374 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-9bab6e8a-1923-426e-85ce-ac475c44a9c0 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:58.535979 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-9bab6e8a-1923-426e-85ce-ac475c44a9c0 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:58.542576 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9bab6e8a-1923-426e-85ce-ac475c44a9c0 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:58.543037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9bab6e8a-1923-426e-85ce-ac475c44a9c0 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:58.543804 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9bab6e8a-1923-426e-85ce-ac475c44a9c0 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:58.544243 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9bab6e8a-1923-426e-85ce-ac475c44a9c0 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:58.687401 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-9bab6e8a-1923-426e-85ce-ac475c44a9c0 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:58.698092 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-9bab6e8a-1923-426e-85ce-ac475c44a9c0 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1315 microversion: 2.1 time: 0.166502 May 26 12:34:58.698835 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 200/387] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:58 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:58.812018 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-17eceba9-0cec-4cf2-b333-30063221e59e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:58.812727 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-17eceba9-0cec-4cf2-b333-30063221e59e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:58.820500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-17eceba9-0cec-4cf2-b333-30063221e59e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:58.821084 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-17eceba9-0cec-4cf2-b333-30063221e59e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:58.821862 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-17eceba9-0cec-4cf2-b333-30063221e59e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:58.822306 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-17eceba9-0cec-4cf2-b333-30063221e59e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:58.835162 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-bdcab80f-e495-47ef-82e4-4a773d8209ce tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:58.835775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-bdcab80f-e495-47ef-82e4-4a773d8209ce tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:58.842623 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bdcab80f-e495-47ef-82e4-4a773d8209ce tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:58.843432 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bdcab80f-e495-47ef-82e4-4a773d8209ce tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:58.844201 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bdcab80f-e495-47ef-82e4-4a773d8209ce tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:58.844811 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bdcab80f-e495-47ef-82e4-4a773d8209ce tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:58.902528 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-17eceba9-0cec-4cf2-b333-30063221e59e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:58.910681 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-17eceba9-0cec-4cf2-b333-30063221e59e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1240 microversion: 2.1 time: 0.102513 May 26 12:34:58.911252 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 188/388] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:58 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1240 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:58.995903 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-bdcab80f-e495-47ef-82e4-4a773d8209ce tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:59.003431 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-bdcab80f-e495-47ef-82e4-4a773d8209ce tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1313 microversion: 2.1 time: 0.173091 May 26 12:34:59.004007 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 201/389] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:58 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:59.263123 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-c8a6c982-0500-4496-8513-56949cf3a656 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:59.263827 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-c8a6c982-0500-4496-8513-56949cf3a656 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:59.270262 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c8a6c982-0500-4496-8513-56949cf3a656 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:59.270813 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c8a6c982-0500-4496-8513-56949cf3a656 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:59.272337 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c8a6c982-0500-4496-8513-56949cf3a656 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:59.272909 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c8a6c982-0500-4496-8513-56949cf3a656 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:59.636078 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c8a6c982-0500-4496-8513-56949cf3a656 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:59.638533 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=100 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:59.645070 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-c8a6c982-0500-4496-8513-56949cf3a656 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.386109 May 26 12:34:59.645625 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 189/390] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:59 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:59.715615 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f18797c9-681f-4c78-8230-cf192bca5ad5 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:59.716247 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f18797c9-681f-4c78-8230-cf192bca5ad5 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:59.722935 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f18797c9-681f-4c78-8230-cf192bca5ad5 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:59.723380 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f18797c9-681f-4c78-8230-cf192bca5ad5 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:59.724155 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f18797c9-681f-4c78-8230-cf192bca5ad5 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:59.724701 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f18797c9-681f-4c78-8230-cf192bca5ad5 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:59.878723 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f18797c9-681f-4c78-8230-cf192bca5ad5 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:34:59.888457 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f18797c9-681f-4c78-8230-cf192bca5ad5 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1315 microversion: 2.1 time: 0.176657 May 26 12:34:59.889526 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 202/391] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:59 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:34:59.927449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-a342d6c3-d5d2-48a4-94d1-30161e3cb6c5 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:34:59.928949 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-a342d6c3-d5d2-48a4-94d1-30161e3cb6c5 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:34:59.935417 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a342d6c3-d5d2-48a4-94d1-30161e3cb6c5 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:59.935869 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a342d6c3-d5d2-48a4-94d1-30161e3cb6c5 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:34:59.936834 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a342d6c3-d5d2-48a4-94d1-30161e3cb6c5 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:34:59.937438 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a342d6c3-d5d2-48a4-94d1-30161e3cb6c5 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:00.003844 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a342d6c3-d5d2-48a4-94d1-30161e3cb6c5 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:00.012342 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-a342d6c3-d5d2-48a4-94d1-30161e3cb6c5 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1240 microversion: 2.1 time: 0.088866 May 26 12:35:00.013012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 190/392] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:34:59 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:00.020937 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-fd61a78d-a8e9-4e1f-a6eb-f1df9456bb68 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:00.021668 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-fd61a78d-a8e9-4e1f-a6eb-f1df9456bb68 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:00.027791 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fd61a78d-a8e9-4e1f-a6eb-f1df9456bb68 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:00.028242 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fd61a78d-a8e9-4e1f-a6eb-f1df9456bb68 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:00.029027 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fd61a78d-a8e9-4e1f-a6eb-f1df9456bb68 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:00.029470 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fd61a78d-a8e9-4e1f-a6eb-f1df9456bb68 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:00.156595 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-fd61a78d-a8e9-4e1f-a6eb-f1df9456bb68 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:00.164588 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-fd61a78d-a8e9-4e1f-a6eb-f1df9456bb68 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1313 microversion: 2.1 time: 0.147634 May 26 12:35:00.165211 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 203/393] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:00 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:00.662238 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-ae8bb394-0263-4460-8629-ef967aced7a0 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:00.662975 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-ae8bb394-0263-4460-8629-ef967aced7a0 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:00.680651 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ae8bb394-0263-4460-8629-ef967aced7a0 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:00.681155 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ae8bb394-0263-4460-8629-ef967aced7a0 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:00.682321 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ae8bb394-0263-4460-8629-ef967aced7a0 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:00.682871 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ae8bb394-0263-4460-8629-ef967aced7a0 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:00.836438 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ae8bb394-0263-4460-8629-ef967aced7a0 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:00.844430 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-ae8bb394-0263-4460-8629-ef967aced7a0 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.186055 May 26 12:35:00.845047 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 191/394] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:00 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:00.905353 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-2517af2e-9c11-45a4-afdc-edb80e3daebf tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:00.906100 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-2517af2e-9c11-45a4-afdc-edb80e3daebf tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:00.912892 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2517af2e-9c11-45a4-afdc-edb80e3daebf tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:00.913379 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2517af2e-9c11-45a4-afdc-edb80e3daebf tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:00.914151 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2517af2e-9c11-45a4-afdc-edb80e3daebf tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:00.914594 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2517af2e-9c11-45a4-afdc-edb80e3daebf tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:01.038419 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6097330f-291b-49be-a3c0-4cc53f3b4601 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:01.041237 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-6097330f-291b-49be-a3c0-4cc53f3b4601 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:01.051874 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6097330f-291b-49be-a3c0-4cc53f3b4601 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:01.052932 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6097330f-291b-49be-a3c0-4cc53f3b4601 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:01.054503 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6097330f-291b-49be-a3c0-4cc53f3b4601 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:01.055162 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6097330f-291b-49be-a3c0-4cc53f3b4601 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:01.179224 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-6097330f-291b-49be-a3c0-4cc53f3b4601 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:01.187880 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-6097330f-291b-49be-a3c0-4cc53f3b4601 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1288 microversion: 2.1 time: 0.161047 May 26 12:35:01.189057 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 192/395] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:01 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1288 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:01.189181 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-2517af2e-9c11-45a4-afdc-edb80e3daebf tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:01.194293 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e6ef7779-fe84-4e83-91ef-2bb3e50bad98 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:01.195306 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-e6ef7779-fe84-4e83-91ef-2bb3e50bad98 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:01.197855 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-2517af2e-9c11-45a4-afdc-edb80e3daebf tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1315 microversion: 2.1 time: 0.296557 May 26 12:35:01.199498 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 204/396] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:00 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:01.211966 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e6ef7779-fe84-4e83-91ef-2bb3e50bad98 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:01.212424 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e6ef7779-fe84-4e83-91ef-2bb3e50bad98 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:01.213243 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e6ef7779-fe84-4e83-91ef-2bb3e50bad98 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:01.213685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e6ef7779-fe84-4e83-91ef-2bb3e50bad98 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:01.372302 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-e6ef7779-fe84-4e83-91ef-2bb3e50bad98 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:01.381358 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-e6ef7779-fe84-4e83-91ef-2bb3e50bad98 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1313 microversion: 2.1 time: 0.190220 May 26 12:35:01.381936 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 193/397] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:01 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:01.862755 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-310ca6f4-4f42-4ec3-91d6-39159306e68a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:01.863367 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-310ca6f4-4f42-4ec3-91d6-39159306e68a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:01.869481 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-310ca6f4-4f42-4ec3-91d6-39159306e68a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:01.869936 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-310ca6f4-4f42-4ec3-91d6-39159306e68a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:01.870694 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-310ca6f4-4f42-4ec3-91d6-39159306e68a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:01.871132 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-310ca6f4-4f42-4ec3-91d6-39159306e68a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:02.005657 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-310ca6f4-4f42-4ec3-91d6-39159306e68a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:02.013860 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-310ca6f4-4f42-4ec3-91d6-39159306e68a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.155059 May 26 12:35:02.014434 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 205/398] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:01 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:02.205062 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-86d8b9c7-dfe0-457c-83f2-c88592fdfc31 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:02.205953 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-86d8b9c7-dfe0-457c-83f2-c88592fdfc31 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:02.215348 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-479e0a51-3eff-4c61-90d8-8a26b337d375 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:02.216343 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-479e0a51-3eff-4c61-90d8-8a26b337d375 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:02.227020 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-479e0a51-3eff-4c61-90d8-8a26b337d375 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:02.227472 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-479e0a51-3eff-4c61-90d8-8a26b337d375 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:02.228251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-479e0a51-3eff-4c61-90d8-8a26b337d375 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:02.228567 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-86d8b9c7-dfe0-457c-83f2-c88592fdfc31 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:02.228695 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-479e0a51-3eff-4c61-90d8-8a26b337d375 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:02.229807 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-86d8b9c7-dfe0-457c-83f2-c88592fdfc31 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:02.230675 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-86d8b9c7-dfe0-457c-83f2-c88592fdfc31 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:02.231665 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-86d8b9c7-dfe0-457c-83f2-c88592fdfc31 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:02.321320 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-86d8b9c7-dfe0-457c-83f2-c88592fdfc31 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:02.330264 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-86d8b9c7-dfe0-457c-83f2-c88592fdfc31 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1296 microversion: 2.1 time: 0.129501 May 26 12:35:02.339223 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 194/399] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:02 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1296 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:02.398917 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-8b886e65-5397-473d-bfa7-4c6f3d29b43c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:02.399518 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-8b886e65-5397-473d-bfa7-4c6f3d29b43c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:02.405603 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8b886e65-5397-473d-bfa7-4c6f3d29b43c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:02.406048 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8b886e65-5397-473d-bfa7-4c6f3d29b43c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:02.407004 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8b886e65-5397-473d-bfa7-4c6f3d29b43c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:02.407440 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8b886e65-5397-473d-bfa7-4c6f3d29b43c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:02.427044 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-479e0a51-3eff-4c61-90d8-8a26b337d375 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:02.438988 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-479e0a51-3eff-4c61-90d8-8a26b337d375 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1315 microversion: 2.1 time: 0.227328 May 26 12:35:02.439798 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 206/400] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:02 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:02.572098 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-8b886e65-5397-473d-bfa7-4c6f3d29b43c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:02.585055 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-8b886e65-5397-473d-bfa7-4c6f3d29b43c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1313 microversion: 2.1 time: 0.190142 May 26 12:35:02.585982 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 195/401] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:02 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:03.031108 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-bfc00e0b-d880-4d6f-8670-f63b342435ee tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:03.031727 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-bfc00e0b-d880-4d6f-8670-f63b342435ee tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:03.037748 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bfc00e0b-d880-4d6f-8670-f63b342435ee tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:03.038255 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bfc00e0b-d880-4d6f-8670-f63b342435ee tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:03.039014 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bfc00e0b-d880-4d6f-8670-f63b342435ee tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:03.039458 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bfc00e0b-d880-4d6f-8670-f63b342435ee tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:03.224061 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-bfc00e0b-d880-4d6f-8670-f63b342435ee tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:03.233012 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-bfc00e0b-d880-4d6f-8670-f63b342435ee tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.205564 May 26 12:35:03.233619 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 207/402] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:03 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:03.348077 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-89fc85d7-014c-4bfe-ad0d-b4fe4cafbf95 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:03.348681 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-89fc85d7-014c-4bfe-ad0d-b4fe4cafbf95 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:03.355688 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-89fc85d7-014c-4bfe-ad0d-b4fe4cafbf95 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:03.356136 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-89fc85d7-014c-4bfe-ad0d-b4fe4cafbf95 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:03.356962 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-89fc85d7-014c-4bfe-ad0d-b4fe4cafbf95 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:03.357399 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-89fc85d7-014c-4bfe-ad0d-b4fe4cafbf95 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:03.420810 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-89fc85d7-014c-4bfe-ad0d-b4fe4cafbf95 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:03.428190 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-89fc85d7-014c-4bfe-ad0d-b4fe4cafbf95 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1296 microversion: 2.1 time: 0.083940 May 26 12:35:03.429341 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 196/403] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:03 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1296 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:03.456177 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-0ae3aa94-c0ee-4faf-ad5d-7597545acfec tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:03.456828 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-0ae3aa94-c0ee-4faf-ad5d-7597545acfec tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:03.463054 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0ae3aa94-c0ee-4faf-ad5d-7597545acfec tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:03.463565 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0ae3aa94-c0ee-4faf-ad5d-7597545acfec tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:03.464463 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0ae3aa94-c0ee-4faf-ad5d-7597545acfec tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:03.464921 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0ae3aa94-c0ee-4faf-ad5d-7597545acfec tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:03.599701 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-0ae3aa94-c0ee-4faf-ad5d-7597545acfec tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:03.608612 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-9dad0529-822f-447f-ac22-5cc64f0b6036 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:03.609264 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-9dad0529-822f-447f-ac22-5cc64f0b6036 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:03.610763 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-0ae3aa94-c0ee-4faf-ad5d-7597545acfec tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1315 microversion: 2.1 time: 0.158206 May 26 12:35:03.611408 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 208/404] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:03 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:03.616864 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9dad0529-822f-447f-ac22-5cc64f0b6036 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:03.617465 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9dad0529-822f-447f-ac22-5cc64f0b6036 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:03.618247 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9dad0529-822f-447f-ac22-5cc64f0b6036 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:03.618684 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9dad0529-822f-447f-ac22-5cc64f0b6036 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:03.765760 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-9dad0529-822f-447f-ac22-5cc64f0b6036 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:03.773280 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-9dad0529-822f-447f-ac22-5cc64f0b6036 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1313 microversion: 2.1 time: 0.168479 May 26 12:35:03.773833 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 197/405] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:03 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:04.105492 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-00cb8645-126a-4bb0-b353-4c44324c3037 req-70c8f942-3346-4897-8f56-6fb242c9018c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31193401-1445-4200-b186-486852801e52", "name": "network-vif-plugged", "status": "completed", "tag": "98473f77-815b-4b93-be44-93cb7ca63380"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:35:04.113990 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-00cb8645-126a-4bb0-b353-4c44324c3037 req-70c8f942-3346-4897-8f56-6fb242c9018c service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:04.114462 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-00cb8645-126a-4bb0-b353-4c44324c3037 req-70c8f942-3346-4897-8f56-6fb242c9018c service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:04.126394 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-00cb8645-126a-4bb0-b353-4c44324c3037 req-70c8f942-3346-4897-8f56-6fb242c9018c service nova] Creating event network-vif-plugged:98473f77-815b-4b93-be44-93cb7ca63380 for instance 31193401-1445-4200-b186-486852801e52 on hv-cinder-81514 May 26 12:35:04.131291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-00cb8645-126a-4bb0-b353-4c44324c3037 req-70c8f942-3346-4897-8f56-6fb242c9018c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029579 May 26 12:35:04.132617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 209/406] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:35:04.250612 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b1471575-b598-4575-a41a-fb67eec7187f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:04.251705 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b1471575-b598-4575-a41a-fb67eec7187f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:04.258167 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b1471575-b598-4575-a41a-fb67eec7187f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:04.258617 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b1471575-b598-4575-a41a-fb67eec7187f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:04.259399 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b1471575-b598-4575-a41a-fb67eec7187f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:04.259840 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b1471575-b598-4575-a41a-fb67eec7187f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:04.390622 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b1471575-b598-4575-a41a-fb67eec7187f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:04.398826 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b1471575-b598-4575-a41a-fb67eec7187f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.152160 May 26 12:35:04.399411 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 198/407] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:04 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:04.446700 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-0ae68e98-1fa3-4244-9aa0-f346c475ac31 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:04.447452 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-0ae68e98-1fa3-4244-9aa0-f346c475ac31 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:04.454017 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0ae68e98-1fa3-4244-9aa0-f346c475ac31 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:04.454468 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0ae68e98-1fa3-4244-9aa0-f346c475ac31 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:04.455234 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0ae68e98-1fa3-4244-9aa0-f346c475ac31 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:04.455675 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0ae68e98-1fa3-4244-9aa0-f346c475ac31 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:04.522867 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-0ae68e98-1fa3-4244-9aa0-f346c475ac31 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:04.530817 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-0ae68e98-1fa3-4244-9aa0-f346c475ac31 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1296 microversion: 2.1 time: 0.088941 May 26 12:35:04.531398 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 210/408] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:04 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1296 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:04.629787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-bc2be125-be73-4457-b7d8-bb65c80670fb tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:04.630383 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-bc2be125-be73-4457-b7d8-bb65c80670fb tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:04.637263 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bc2be125-be73-4457-b7d8-bb65c80670fb tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:04.637710 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bc2be125-be73-4457-b7d8-bb65c80670fb tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:04.638517 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bc2be125-be73-4457-b7d8-bb65c80670fb tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:04.639310 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bc2be125-be73-4457-b7d8-bb65c80670fb tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:04.775676 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-bc2be125-be73-4457-b7d8-bb65c80670fb tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:04.784701 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-bc2be125-be73-4457-b7d8-bb65c80670fb tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1315 microversion: 2.1 time: 0.158084 May 26 12:35:04.786031 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 199/409] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:04 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:04.795647 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d61b0ba5-395c-4f6f-8c11-c57e0c338dc1 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:04.796474 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d61b0ba5-395c-4f6f-8c11-c57e0c338dc1 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:04.803642 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d61b0ba5-395c-4f6f-8c11-c57e0c338dc1 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:04.804127 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d61b0ba5-395c-4f6f-8c11-c57e0c338dc1 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:04.804934 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d61b0ba5-395c-4f6f-8c11-c57e0c338dc1 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:04.805378 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d61b0ba5-395c-4f6f-8c11-c57e0c338dc1 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:04.934817 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d61b0ba5-395c-4f6f-8c11-c57e0c338dc1 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:04.942339 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-d61b0ba5-395c-4f6f-8c11-c57e0c338dc1 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1313 microversion: 2.1 time: 0.154881 May 26 12:35:04.942896 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 211/410] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:04 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:05.416892 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-32c8ce0d-6fab-42fa-a490-5edc43d0a0fc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:05.417583 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-32c8ce0d-6fab-42fa-a490-5edc43d0a0fc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:05.424757 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-32c8ce0d-6fab-42fa-a490-5edc43d0a0fc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:05.425242 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-32c8ce0d-6fab-42fa-a490-5edc43d0a0fc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:05.426052 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-32c8ce0d-6fab-42fa-a490-5edc43d0a0fc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:05.426487 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-32c8ce0d-6fab-42fa-a490-5edc43d0a0fc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:05.548560 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-21f8d3b3-3c50-485d-92da-fae90b40b71d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:05.549983 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-21f8d3b3-3c50-485d-92da-fae90b40b71d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:05.556380 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-21f8d3b3-3c50-485d-92da-fae90b40b71d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:05.556855 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-21f8d3b3-3c50-485d-92da-fae90b40b71d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:05.557633 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-21f8d3b3-3c50-485d-92da-fae90b40b71d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:05.558069 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-21f8d3b3-3c50-485d-92da-fae90b40b71d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:05.565566 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-32c8ce0d-6fab-42fa-a490-5edc43d0a0fc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:05.574081 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-32c8ce0d-6fab-42fa-a490-5edc43d0a0fc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.161849 May 26 12:35:05.574785 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 200/411] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:05 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:05.627367 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-21f8d3b3-3c50-485d-92da-fae90b40b71d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:05.635349 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-21f8d3b3-3c50-485d-92da-fae90b40b71d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1296 microversion: 2.1 time: 0.090738 May 26 12:35:05.635902 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 212/412] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:05 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1296 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:05.803358 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-55ac8656-c271-4eb5-a4d1-19d519eee6a3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:05.804127 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-55ac8656-c271-4eb5-a4d1-19d519eee6a3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:05.810279 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-55ac8656-c271-4eb5-a4d1-19d519eee6a3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:05.810730 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-55ac8656-c271-4eb5-a4d1-19d519eee6a3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:05.811483 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-55ac8656-c271-4eb5-a4d1-19d519eee6a3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:05.811920 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-55ac8656-c271-4eb5-a4d1-19d519eee6a3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:05.952569 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-55ac8656-c271-4eb5-a4d1-19d519eee6a3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:05.959195 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-c4091688-251c-4a62-b288-ef33bff5f4a3 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:05.960452 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-c4091688-251c-4a62-b288-ef33bff5f4a3 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:05.961717 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-55ac8656-c271-4eb5-a4d1-19d519eee6a3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1315 microversion: 2.1 time: 0.162265 May 26 12:35:05.962654 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 201/413] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:05 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:05.966458 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c4091688-251c-4a62-b288-ef33bff5f4a3 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:05.966913 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c4091688-251c-4a62-b288-ef33bff5f4a3 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:05.967676 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c4091688-251c-4a62-b288-ef33bff5f4a3 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:05.968287 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c4091688-251c-4a62-b288-ef33bff5f4a3 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:06.110198 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-c4091688-251c-4a62-b288-ef33bff5f4a3 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:06.112490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=100 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:06.119651 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-c4091688-251c-4a62-b288-ef33bff5f4a3 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1313 microversion: 2.1 time: 0.164305 May 26 12:35:06.120219 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 213/414] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:05 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:06.592744 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-06b75837-64fd-49d1-aef9-e8b2394eae1d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:06.593350 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-06b75837-64fd-49d1-aef9-e8b2394eae1d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:06.601776 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-06b75837-64fd-49d1-aef9-e8b2394eae1d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:06.602226 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-06b75837-64fd-49d1-aef9-e8b2394eae1d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:06.602998 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-06b75837-64fd-49d1-aef9-e8b2394eae1d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:06.603434 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-06b75837-64fd-49d1-aef9-e8b2394eae1d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:06.653471 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-bb05b4ea-46d6-455f-b76f-aaf9703eb183 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:06.654820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-bb05b4ea-46d6-455f-b76f-aaf9703eb183 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:06.661621 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bb05b4ea-46d6-455f-b76f-aaf9703eb183 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:06.662483 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bb05b4ea-46d6-455f-b76f-aaf9703eb183 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:06.663369 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bb05b4ea-46d6-455f-b76f-aaf9703eb183 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:06.664071 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bb05b4ea-46d6-455f-b76f-aaf9703eb183 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:06.739756 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-bb05b4ea-46d6-455f-b76f-aaf9703eb183 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:06.747652 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-bb05b4ea-46d6-455f-b76f-aaf9703eb183 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1296 microversion: 2.1 time: 0.098352 May 26 12:35:06.748217 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 214/415] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:06 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1296 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:06.770495 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-06b75837-64fd-49d1-aef9-e8b2394eae1d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:06.778990 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-06b75837-64fd-49d1-aef9-e8b2394eae1d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.190090 May 26 12:35:06.779540 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 202/416] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:06 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:06.978383 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-25200928-3365-4eb2-996b-2c2d949e23fd tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:06.985597 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-25200928-3365-4eb2-996b-2c2d949e23fd tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:06.993959 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-25200928-3365-4eb2-996b-2c2d949e23fd tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:06.994631 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-25200928-3365-4eb2-996b-2c2d949e23fd tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:06.995635 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-25200928-3365-4eb2-996b-2c2d949e23fd tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:06.996528 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-25200928-3365-4eb2-996b-2c2d949e23fd tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:07.103267 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=2 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:07.139148 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-16a7dabf-87e1-48d2-a9ee-e922594efe4c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:07.139868 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-16a7dabf-87e1-48d2-a9ee-e922594efe4c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:07.148356 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=22 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:07.153463 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-16a7dabf-87e1-48d2-a9ee-e922594efe4c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:07.155246 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-16a7dabf-87e1-48d2-a9ee-e922594efe4c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:07.157585 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-16a7dabf-87e1-48d2-a9ee-e922594efe4c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:07.157585 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-16a7dabf-87e1-48d2-a9ee-e922594efe4c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:07.353359 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-25200928-3365-4eb2-996b-2c2d949e23fd tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:07.361394 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-25200928-3365-4eb2-996b-2c2d949e23fd tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1315 microversion: 2.1 time: 0.387273 May 26 12:35:07.361991 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 215/417] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:06 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:07.400428 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-16a7dabf-87e1-48d2-a9ee-e922594efe4c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:07.407931 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-16a7dabf-87e1-48d2-a9ee-e922594efe4c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1313 microversion: 2.1 time: 0.273486 May 26 12:35:07.408491 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 203/418] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:07 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:07.766604 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-2e961f3c-cc69-4d9b-b789-ce3c8f65416d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:07.767225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-2e961f3c-cc69-4d9b-b789-ce3c8f65416d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:07.769085 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:07.776024 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2e961f3c-cc69-4d9b-b789-ce3c8f65416d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:07.776481 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2e961f3c-cc69-4d9b-b789-ce3c8f65416d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:07.777296 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2e961f3c-cc69-4d9b-b789-ce3c8f65416d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:07.777743 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2e961f3c-cc69-4d9b-b789-ce3c8f65416d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:07.795547 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e4aa2c33-0603-4dc7-af63-4a2a12a8f41f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:07.796197 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-e4aa2c33-0603-4dc7-af63-4a2a12a8f41f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:07.798500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell0:SELECT=2 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:07.805409 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e4aa2c33-0603-4dc7-af63-4a2a12a8f41f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:07.806007 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e4aa2c33-0603-4dc7-af63-4a2a12a8f41f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:07.807304 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e4aa2c33-0603-4dc7-af63-4a2a12a8f41f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:07.808091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e4aa2c33-0603-4dc7-af63-4a2a12a8f41f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:07.873130 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-2e961f3c-cc69-4d9b-b789-ce3c8f65416d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:07.881056 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-2e961f3c-cc69-4d9b-b789-ce3c8f65416d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1294 microversion: 2.1 time: 0.118258 May 26 12:35:07.882128 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 216/419] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:07 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1294 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:08.080174 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-e4aa2c33-0603-4dc7-af63-4a2a12a8f41f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:08.088135 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-e4aa2c33-0603-4dc7-af63-4a2a12a8f41f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.296591 May 26 12:35:08.088701 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 204/420] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:07 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:08.385971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e32b6953-4465-4d8e-a36a-bda464276da2 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:08.385971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e32b6953-4465-4d8e-a36a-bda464276da2 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:08.395802 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e32b6953-4465-4d8e-a36a-bda464276da2 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:08.396264 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e32b6953-4465-4d8e-a36a-bda464276da2 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:08.397150 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e32b6953-4465-4d8e-a36a-bda464276da2 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:08.397797 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e32b6953-4465-4d8e-a36a-bda464276da2 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:08.425504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e8f3530d-7ad0-4728-993a-cea34be1dace tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:08.426410 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-e8f3530d-7ad0-4728-993a-cea34be1dace tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:08.435102 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e8f3530d-7ad0-4728-993a-cea34be1dace tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:08.435919 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e8f3530d-7ad0-4728-993a-cea34be1dace tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:08.437075 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e8f3530d-7ad0-4728-993a-cea34be1dace tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:08.437958 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e8f3530d-7ad0-4728-993a-cea34be1dace tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:08.687062 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e32b6953-4465-4d8e-a36a-bda464276da2 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:08.697256 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e32b6953-4465-4d8e-a36a-bda464276da2 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1315 microversion: 2.1 time: 0.321670 May 26 12:35:08.706707 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 217/421] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:08 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:08.715814 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-e8f3530d-7ad0-4728-993a-cea34be1dace tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:08.725392 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-e8f3530d-7ad0-4728-993a-cea34be1dace tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1313 microversion: 2.1 time: 0.303649 May 26 12:35:08.726480 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 205/422] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:08 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:08.767154 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-df752aa3-4e5b-4ddf-b8b7-40517b67039a req-463f38fa-b5a8-467e-88f2-2101e22fdc19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50249dcb-fe40-45b9-a40e-07242ec49ca2", "name": "network-vif-plugged", "status": "completed", "tag": "66c6c832-2921-4950-a94c-a7d04e78d89d"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:35:08.778366 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-df752aa3-4e5b-4ddf-b8b7-40517b67039a req-463f38fa-b5a8-467e-88f2-2101e22fdc19 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:08.778894 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-df752aa3-4e5b-4ddf-b8b7-40517b67039a req-463f38fa-b5a8-467e-88f2-2101e22fdc19 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:08.792391 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-df752aa3-4e5b-4ddf-b8b7-40517b67039a req-463f38fa-b5a8-467e-88f2-2101e22fdc19 service nova] Creating event network-vif-plugged:66c6c832-2921-4950-a94c-a7d04e78d89d for instance 50249dcb-fe40-45b9-a40e-07242ec49ca2 on hv-cinder-81514 May 26 12:35:08.797431 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-df752aa3-4e5b-4ddf-b8b7-40517b67039a req-463f38fa-b5a8-467e-88f2-2101e22fdc19 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034995 May 26 12:35:08.798015 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 218/423] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:35:08.899712 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-62de0163-4c28-4e60-a925-933e340ec3d0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:08.900328 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-62de0163-4c28-4e60-a925-933e340ec3d0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:08.912560 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-62de0163-4c28-4e60-a925-933e340ec3d0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:08.913145 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-62de0163-4c28-4e60-a925-933e340ec3d0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:08.914091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-62de0163-4c28-4e60-a925-933e340ec3d0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:08.914532 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-62de0163-4c28-4e60-a925-933e340ec3d0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:08.929791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=100 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:09.106227 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-02f6d3bc-6bed-4f76-843f-91ae0e655a5f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:09.107636 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-02f6d3bc-6bed-4f76-843f-91ae0e655a5f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:09.117824 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-02f6d3bc-6bed-4f76-843f-91ae0e655a5f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:09.118269 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-02f6d3bc-6bed-4f76-843f-91ae0e655a5f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:09.119386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-02f6d3bc-6bed-4f76-843f-91ae0e655a5f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:09.119835 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-02f6d3bc-6bed-4f76-843f-91ae0e655a5f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:09.129368 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-62de0163-4c28-4e60-a925-933e340ec3d0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:09.161754 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-62de0163-4c28-4e60-a925-933e340ec3d0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1360 microversion: 2.1 time: 0.261636 May 26 12:35:09.164953 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 206/424] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:08 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1360 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:09.359556 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-02f6d3bc-6bed-4f76-843f-91ae0e655a5f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:09.367757 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-02f6d3bc-6bed-4f76-843f-91ae0e655a5f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1522 microversion: 2.1 time: 0.265863 May 26 12:35:09.368402 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 219/425] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:09 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:09.469254 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-73a0f531-c097-4d97-a005-7b9c83f20c1e req-2e016f30-1fae-4162-b97e-365f84e454c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1220de98-5d9e-4c46-937d-52199dd249c3", "tag": "d74c1ce6-0777-4077-8c1e-3845bcaf0256"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:35:09.478068 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-73a0f531-c097-4d97-a005-7b9c83f20c1e req-2e016f30-1fae-4162-b97e-365f84e454c3 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:09.478573 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-73a0f531-c097-4d97-a005-7b9c83f20c1e req-2e016f30-1fae-4162-b97e-365f84e454c3 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:09.490163 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-73a0f531-c097-4d97-a005-7b9c83f20c1e req-2e016f30-1fae-4162-b97e-365f84e454c3 service nova] Creating event network-changed:d74c1ce6-0777-4077-8c1e-3845bcaf0256 for instance 1220de98-5d9e-4c46-937d-52199dd249c3 on hv-cinder-81514 May 26 12:35:09.496047 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-73a0f531-c097-4d97-a005-7b9c83f20c1e req-2e016f30-1fae-4162-b97e-365f84e454c3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030427 May 26 12:35:09.496653 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 207/426] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:35:09.714402 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-1960433a-53ae-4786-9cf7-bc12b3362bab tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:09.714948 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-1960433a-53ae-4786-9cf7-bc12b3362bab tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:09.721077 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1960433a-53ae-4786-9cf7-bc12b3362bab tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:09.721527 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1960433a-53ae-4786-9cf7-bc12b3362bab tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:09.722291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1960433a-53ae-4786-9cf7-bc12b3362bab tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:09.722734 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1960433a-53ae-4786-9cf7-bc12b3362bab tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:09.743973 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-02c59e78-9e89-49ad-9f2d-c96e732a7642 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:09.744875 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-02c59e78-9e89-49ad-9f2d-c96e732a7642 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:09.751018 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-02c59e78-9e89-49ad-9f2d-c96e732a7642 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:09.751463 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-02c59e78-9e89-49ad-9f2d-c96e732a7642 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:09.752242 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-02c59e78-9e89-49ad-9f2d-c96e732a7642 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:09.752682 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-02c59e78-9e89-49ad-9f2d-c96e732a7642 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:09.932591 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-1960433a-53ae-4786-9cf7-bc12b3362bab tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:09.944772 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-1960433a-53ae-4786-9cf7-bc12b3362bab tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1315 microversion: 2.1 time: 0.234014 May 26 12:35:09.945691 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 220/427] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:09 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:09.948037 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-02c59e78-9e89-49ad-9f2d-c96e732a7642 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:09.956456 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-02c59e78-9e89-49ad-9f2d-c96e732a7642 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1313 microversion: 2.1 time: 0.217365 May 26 12:35:09.957038 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 208/428] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:09 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:10.180804 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e5798f5c-5c84-4b0f-acc1-bd9fec7d2a41 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:10.181353 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e5798f5c-5c84-4b0f-acc1-bd9fec7d2a41 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:10.187319 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e5798f5c-5c84-4b0f-acc1-bd9fec7d2a41 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:10.187770 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e5798f5c-5c84-4b0f-acc1-bd9fec7d2a41 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:10.188527 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e5798f5c-5c84-4b0f-acc1-bd9fec7d2a41 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:10.188988 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e5798f5c-5c84-4b0f-acc1-bd9fec7d2a41 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:10.315169 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e5798f5c-5c84-4b0f-acc1-bd9fec7d2a41 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:10.322917 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e5798f5c-5c84-4b0f-acc1-bd9fec7d2a41 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1360 microversion: 2.1 time: 0.146394 May 26 12:35:10.323473 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 221/429] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:10 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1360 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:10.385476 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f2319c3f-3afc-4a31-bada-2c3040ec5fdb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:10.386082 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-f2319c3f-3afc-4a31-bada-2c3040ec5fdb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:10.392226 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f2319c3f-3afc-4a31-bada-2c3040ec5fdb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:10.392675 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f2319c3f-3afc-4a31-bada-2c3040ec5fdb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:10.393463 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f2319c3f-3afc-4a31-bada-2c3040ec5fdb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:10.393911 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f2319c3f-3afc-4a31-bada-2c3040ec5fdb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:10.523788 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-f2319c3f-3afc-4a31-bada-2c3040ec5fdb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:10.531210 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-f2319c3f-3afc-4a31-bada-2c3040ec5fdb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1502 microversion: 2.1 time: 0.150744 May 26 12:35:10.531771 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 209/430] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:10 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:10.546906 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f6765348-625e-4d00-8231-79fd5524b994 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:10.547552 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f6765348-625e-4d00-8231-79fd5524b994 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:10.553881 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f6765348-625e-4d00-8231-79fd5524b994 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:10.554333 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f6765348-625e-4d00-8231-79fd5524b994 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:10.555103 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f6765348-625e-4d00-8231-79fd5524b994 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:10.555547 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f6765348-625e-4d00-8231-79fd5524b994 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:10.688879 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f6765348-625e-4d00-8231-79fd5524b994 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:10.697595 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f6765348-625e-4d00-8231-79fd5524b994 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1517 microversion: 2.1 time: 0.154615 May 26 12:35:10.698155 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 222/431] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:10 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:10.968368 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-99feccc8-13e3-437f-8283-f4cc0e7caad3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:10.969085 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-99feccc8-13e3-437f-8283-f4cc0e7caad3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:10.976697 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-99feccc8-13e3-437f-8283-f4cc0e7caad3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:10.977117 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-99feccc8-13e3-437f-8283-f4cc0e7caad3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:10.977886 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-99feccc8-13e3-437f-8283-f4cc0e7caad3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:10.978324 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-99feccc8-13e3-437f-8283-f4cc0e7caad3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:10.980788 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-5131312f-2ab1-4e10-95eb-c8b108717623 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:10.981896 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-5131312f-2ab1-4e10-95eb-c8b108717623 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:10.988520 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5131312f-2ab1-4e10-95eb-c8b108717623 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:10.988994 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5131312f-2ab1-4e10-95eb-c8b108717623 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:10.989761 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5131312f-2ab1-4e10-95eb-c8b108717623 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:10.990205 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5131312f-2ab1-4e10-95eb-c8b108717623 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:11.213370 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-5131312f-2ab1-4e10-95eb-c8b108717623 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:11.215811 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-99feccc8-13e3-437f-8283-f4cc0e7caad3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:11.221982 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-5131312f-2ab1-4e10-95eb-c8b108717623 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1313 microversion: 2.1 time: 0.252084 May 26 12:35:11.222558 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 223/432] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:10 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:11.224393 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-99feccc8-13e3-437f-8283-f4cc0e7caad3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1465 microversion: 2.1 time: 0.266565 May 26 12:35:11.225646 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 210/433] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:10 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1465 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:11.274114 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-bc9bcfe7-070b-4387-961d-ac9af594e0c1 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:11.274602 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-bc9bcfe7-070b-4387-961d-ac9af594e0c1 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:11.282422 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bc9bcfe7-070b-4387-961d-ac9af594e0c1 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:11.282871 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bc9bcfe7-070b-4387-961d-ac9af594e0c1 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:11.283635 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bc9bcfe7-070b-4387-961d-ac9af594e0c1 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:11.284068 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bc9bcfe7-070b-4387-961d-ac9af594e0c1 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:11.314982 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-bc9bcfe7-070b-4387-961d-ac9af594e0c1 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Going to try to terminate instance {{(pid=124133) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:35:11.340169 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-76eb1b34-0b0c-47ac-bd46-f5e33de1708c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:11.340969 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-76eb1b34-0b0c-47ac-bd46-f5e33de1708c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:11.349279 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-76eb1b34-0b0c-47ac-bd46-f5e33de1708c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:11.349771 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-76eb1b34-0b0c-47ac-bd46-f5e33de1708c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:11.350936 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-76eb1b34-0b0c-47ac-bd46-f5e33de1708c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:11.351697 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-76eb1b34-0b0c-47ac-bd46-f5e33de1708c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:11.452855 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-bc9bcfe7-070b-4387-961d-ac9af594e0c1 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "DELETE /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 204 len: 0 microversion: 2.1 time: 0.182203 May 26 12:35:11.456926 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 224/434] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:35:11 2022] DELETE /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:35:11.463520 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-37da25c4-05e3-4e73-9d5f-32fc32756368 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:11.464217 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-37da25c4-05e3-4e73-9d5f-32fc32756368 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:11.473863 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-37da25c4-05e3-4e73-9d5f-32fc32756368 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:11.474670 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-37da25c4-05e3-4e73-9d5f-32fc32756368 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:11.476747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-37da25c4-05e3-4e73-9d5f-32fc32756368 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:11.477515 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-37da25c4-05e3-4e73-9d5f-32fc32756368 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:11.936882 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-76eb1b34-0b0c-47ac-bd46-f5e33de1708c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:11.944298 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-76eb1b34-0b0c-47ac-bd46-f5e33de1708c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1360 microversion: 2.1 time: 0.607959 May 26 12:35:11.944976 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 211/435] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:11 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1360 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:11.963217 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-37da25c4-05e3-4e73-9d5f-32fc32756368 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:11.972127 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-37da25c4-05e3-4e73-9d5f-32fc32756368 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1471 microversion: 2.1 time: 0.513885 May 26 12:35:11.972728 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 225/436] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:11 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1471 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:12.238915 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-d2d1c2fe-178a-47ff-861c-c2c8c066b23c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:12.239513 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-d2d1c2fe-178a-47ff-861c-c2c8c066b23c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:12.247058 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d2d1c2fe-178a-47ff-861c-c2c8c066b23c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:12.247877 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d2d1c2fe-178a-47ff-861c-c2c8c066b23c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:12.249282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d2d1c2fe-178a-47ff-861c-c2c8c066b23c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:12.250040 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d2d1c2fe-178a-47ff-861c-c2c8c066b23c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:12.395219 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d2d1c2fe-178a-47ff-861c-c2c8c066b23c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:12.403250 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-d2d1c2fe-178a-47ff-861c-c2c8c066b23c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1313 microversion: 2.1 time: 0.168220 May 26 12:35:12.403794 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 212/437] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:12 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:12.961220 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-88df135b-79f1-4dc9-adae-00ed32342d5e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:12.961860 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-88df135b-79f1-4dc9-adae-00ed32342d5e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:12.968109 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-88df135b-79f1-4dc9-adae-00ed32342d5e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:12.968560 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-88df135b-79f1-4dc9-adae-00ed32342d5e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:12.969354 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-88df135b-79f1-4dc9-adae-00ed32342d5e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:12.969796 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-88df135b-79f1-4dc9-adae-00ed32342d5e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:12.990105 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-39123f0b-7ec0-4c81-a236-ec007542f56e tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:12.990754 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-39123f0b-7ec0-4c81-a236-ec007542f56e tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:12.997134 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-39123f0b-7ec0-4c81-a236-ec007542f56e tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:12.997582 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-39123f0b-7ec0-4c81-a236-ec007542f56e tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:12.998346 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-39123f0b-7ec0-4c81-a236-ec007542f56e tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:12.998780 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-39123f0b-7ec0-4c81-a236-ec007542f56e tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:13.182772 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-88df135b-79f1-4dc9-adae-00ed32342d5e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:13.189789 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-39123f0b-7ec0-4c81-a236-ec007542f56e tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:13.190101 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-88df135b-79f1-4dc9-adae-00ed32342d5e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1360 microversion: 2.1 time: 0.232784 May 26 12:35:13.190664 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 226/438] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:12 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1360 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:13.197650 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-9c68ef0d-5c16-4497-8d66-a88c1c03b345 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:35:13.198501 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-39123f0b-7ec0-4c81-a236-ec007542f56e tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1471 microversion: 2.1 time: 0.212195 May 26 12:35:13.198684 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-9c68ef0d-5c16-4497-8d66-a88c1c03b345 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:13.199389 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 213/439] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:12 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1471 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:13.205526 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9c68ef0d-5c16-4497-8d66-a88c1c03b345 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:13.205975 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9c68ef0d-5c16-4497-8d66-a88c1c03b345 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:13.206737 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9c68ef0d-5c16-4497-8d66-a88c1c03b345 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:13.207205 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9c68ef0d-5c16-4497-8d66-a88c1c03b345 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:13.229932 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.objects.instance [None req-9c68ef0d-5c16-4497-8d66-a88c1c03b345 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lazy-loading 'flavor' on Instance uuid 131042dc-6807-4136-b6ed-7aead934b6b2 {{(pid=124133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:35:13.319988 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:13.342193 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-9c68ef0d-5c16-4497-8d66-a88c1c03b345 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "POST /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2/action" status: 200 len: 32 microversion: 2.1 time: 0.150327 May 26 12:35:13.342792 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 227/440] 10.222.0.39 () {60 vars in 1277 bytes} [Thu May 26 12:35:13 2022] POST /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2/action => generated 32 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:35:13.353487 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e69e0a60-6803-4cdf-9295-5774dd16faeb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:13.354098 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-e69e0a60-6803-4cdf-9295-5774dd16faeb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:13.362468 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e69e0a60-6803-4cdf-9295-5774dd16faeb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:13.362929 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e69e0a60-6803-4cdf-9295-5774dd16faeb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:13.363699 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e69e0a60-6803-4cdf-9295-5774dd16faeb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:13.364138 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e69e0a60-6803-4cdf-9295-5774dd16faeb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:13.420590 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ceeb07c1-a9cd-44d7-8dea-072d11d2baad tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:13.421333 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ceeb07c1-a9cd-44d7-8dea-072d11d2baad tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:13.427651 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ceeb07c1-a9cd-44d7-8dea-072d11d2baad tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:13.428202 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ceeb07c1-a9cd-44d7-8dea-072d11d2baad tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:13.429659 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ceeb07c1-a9cd-44d7-8dea-072d11d2baad tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:13.430175 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ceeb07c1-a9cd-44d7-8dea-072d11d2baad tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:13.555400 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-e69e0a60-6803-4cdf-9295-5774dd16faeb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:13.563969 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-e69e0a60-6803-4cdf-9295-5774dd16faeb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1523 microversion: 2.1 time: 0.214836 May 26 12:35:13.574144 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 214/441] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:13 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:13.591944 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ceeb07c1-a9cd-44d7-8dea-072d11d2baad tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:13.599348 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ceeb07c1-a9cd-44d7-8dea-072d11d2baad tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1313 microversion: 2.1 time: 0.183129 May 26 12:35:13.599897 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 228/442] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:13 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:14.207387 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-3e5a45c1-8892-44d1-8bee-49bd2d607f34 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:14.207990 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-3e5a45c1-8892-44d1-8bee-49bd2d607f34 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:14.214959 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3e5a45c1-8892-44d1-8bee-49bd2d607f34 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:14.215417 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3e5a45c1-8892-44d1-8bee-49bd2d607f34 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:14.215842 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-4ceb9cfc-fb4f-45ce-a86d-07b8c894fa93 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:14.216278 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3e5a45c1-8892-44d1-8bee-49bd2d607f34 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:14.216483 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-4ceb9cfc-fb4f-45ce-a86d-07b8c894fa93 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:14.216582 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3e5a45c1-8892-44d1-8bee-49bd2d607f34 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:14.224119 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4ceb9cfc-fb4f-45ce-a86d-07b8c894fa93 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:14.224632 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4ceb9cfc-fb4f-45ce-a86d-07b8c894fa93 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:14.225964 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4ceb9cfc-fb4f-45ce-a86d-07b8c894fa93 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:14.226651 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4ceb9cfc-fb4f-45ce-a86d-07b8c894fa93 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:14.434122 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-3e5a45c1-8892-44d1-8bee-49bd2d607f34 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:14.438818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-4ceb9cfc-fb4f-45ce-a86d-07b8c894fa93 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:14.442370 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-3e5a45c1-8892-44d1-8bee-49bd2d607f34 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1360 microversion: 2.1 time: 0.238866 May 26 12:35:14.442943 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 215/443] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:14 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1360 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:14.447307 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-4ceb9cfc-fb4f-45ce-a86d-07b8c894fa93 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1471 microversion: 2.1 time: 0.235275 May 26 12:35:14.447864 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 229/444] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:14 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1471 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:14.582807 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-4dc3945b-ab59-490d-b74b-d4ac172e553d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:14.583425 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-4dc3945b-ab59-490d-b74b-d4ac172e553d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:14.590124 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4dc3945b-ab59-490d-b74b-d4ac172e553d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:14.590571 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4dc3945b-ab59-490d-b74b-d4ac172e553d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:14.591377 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4dc3945b-ab59-490d-b74b-d4ac172e553d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:14.591821 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4dc3945b-ab59-490d-b74b-d4ac172e553d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:14.616930 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d3c91ca1-0480-45e6-b540-24b79ed221eb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:14.617807 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d3c91ca1-0480-45e6-b540-24b79ed221eb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:14.623730 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d3c91ca1-0480-45e6-b540-24b79ed221eb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:14.624180 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d3c91ca1-0480-45e6-b540-24b79ed221eb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:14.624968 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d3c91ca1-0480-45e6-b540-24b79ed221eb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:14.625412 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d3c91ca1-0480-45e6-b540-24b79ed221eb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:14.775116 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-4dc3945b-ab59-490d-b74b-d4ac172e553d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:14.782883 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-4dc3945b-ab59-490d-b74b-d4ac172e553d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1523 microversion: 2.1 time: 0.204933 May 26 12:35:14.785340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 216/445] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:14 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:14.869733 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d3c91ca1-0480-45e6-b540-24b79ed221eb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:14.892112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-d3c91ca1-0480-45e6-b540-24b79ed221eb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1313 microversion: 2.1 time: 0.279510 May 26 12:35:14.892845 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 230/446] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:14 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:15.462044 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-1e50ad96-9c8f-4b34-9953-61f892744cf3 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:15.462823 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-1e50ad96-9c8f-4b34-9953-61f892744cf3 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:15.472871 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ab2b74eb-a1aa-40b5-b3b4-13a6f8a86106 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:15.473542 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ab2b74eb-a1aa-40b5-b3b4-13a6f8a86106 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:15.474600 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1e50ad96-9c8f-4b34-9953-61f892744cf3 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:15.475881 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1e50ad96-9c8f-4b34-9953-61f892744cf3 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:15.477821 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1e50ad96-9c8f-4b34-9953-61f892744cf3 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:15.478682 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1e50ad96-9c8f-4b34-9953-61f892744cf3 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:15.486161 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ab2b74eb-a1aa-40b5-b3b4-13a6f8a86106 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:15.495747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ab2b74eb-a1aa-40b5-b3b4-13a6f8a86106 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:15.496755 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ab2b74eb-a1aa-40b5-b3b4-13a6f8a86106 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:15.497199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ab2b74eb-a1aa-40b5-b3b4-13a6f8a86106 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:15.588611 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ab2b74eb-a1aa-40b5-b3b4-13a6f8a86106 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:15.595969 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ab2b74eb-a1aa-40b5-b3b4-13a6f8a86106 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1429 microversion: 2.1 time: 0.135978 May 26 12:35:15.596634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 231/447] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:15 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1429 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:15.602671 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-5a7d8be8-313e-4bc2-b160-f62bb5ec7bb1 req-838fa2af-48d1-46e5-892b-be36d240df1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31193401-1445-4200-b186-486852801e52", "name": "network-vif-deleted", "tag": "98473f77-815b-4b93-be44-93cb7ca63380"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:35:15.614421 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-5a7d8be8-313e-4bc2-b160-f62bb5ec7bb1 req-838fa2af-48d1-46e5-892b-be36d240df1a service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:15.614931 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-5a7d8be8-313e-4bc2-b160-f62bb5ec7bb1 req-838fa2af-48d1-46e5-892b-be36d240df1a service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:15.629728 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-5a7d8be8-313e-4bc2-b160-f62bb5ec7bb1 req-838fa2af-48d1-46e5-892b-be36d240df1a service nova] Creating event network-vif-deleted:98473f77-815b-4b93-be44-93cb7ca63380 for instance 31193401-1445-4200-b186-486852801e52 on hv-cinder-81514 May 26 12:35:15.635416 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-5a7d8be8-313e-4bc2-b160-f62bb5ec7bb1 req-838fa2af-48d1-46e5-892b-be36d240df1a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037260 May 26 12:35:15.636026 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 232/448] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:35:15.665811 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-1e50ad96-9c8f-4b34-9953-61f892744cf3 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:15.673300 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-1e50ad96-9c8f-4b34-9953-61f892744cf3 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1360 microversion: 2.1 time: 0.216985 May 26 12:35:15.673870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 217/449] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:15 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1360 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:15.802374 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-acc660d8-b40f-4469-8ce6-da54c7afb4ac tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:15.803073 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-acc660d8-b40f-4469-8ce6-da54c7afb4ac tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:15.809961 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-acc660d8-b40f-4469-8ce6-da54c7afb4ac tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:15.810442 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-acc660d8-b40f-4469-8ce6-da54c7afb4ac tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:15.811207 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-acc660d8-b40f-4469-8ce6-da54c7afb4ac tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:15.811651 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-acc660d8-b40f-4469-8ce6-da54c7afb4ac tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:15.908806 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-ab993f92-2109-4ffb-8d7c-afa91c3da1f0 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:15.909410 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-ab993f92-2109-4ffb-8d7c-afa91c3da1f0 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:15.916363 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ab993f92-2109-4ffb-8d7c-afa91c3da1f0 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:15.916850 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ab993f92-2109-4ffb-8d7c-afa91c3da1f0 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:15.917611 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ab993f92-2109-4ffb-8d7c-afa91c3da1f0 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:15.918041 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ab993f92-2109-4ffb-8d7c-afa91c3da1f0 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:15.946333 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-acc660d8-b40f-4469-8ce6-da54c7afb4ac tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:15.954068 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-acc660d8-b40f-4469-8ce6-da54c7afb4ac tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1523 microversion: 2.1 time: 0.155932 May 26 12:35:15.954722 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 233/450] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:15 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:16.047882 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ab993f92-2109-4ffb-8d7c-afa91c3da1f0 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:16.055844 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-ab993f92-2109-4ffb-8d7c-afa91c3da1f0 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1496 microversion: 2.1 time: 0.150790 May 26 12:35:16.056422 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 218/451] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:15 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1496 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:16.613803 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d50a406e-9f21-41eb-9757-83dcef97b590 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:16.614410 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d50a406e-9f21-41eb-9757-83dcef97b590 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:16.620572 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d50a406e-9f21-41eb-9757-83dcef97b590 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:16.621050 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d50a406e-9f21-41eb-9757-83dcef97b590 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:16.621810 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d50a406e-9f21-41eb-9757-83dcef97b590 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:16.622253 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d50a406e-9f21-41eb-9757-83dcef97b590 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:16.655225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d50a406e-9f21-41eb-9757-83dcef97b590 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:16.655768 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d50a406e-9f21-41eb-9757-83dcef97b590 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:16.656146 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.objects.instance [None req-d50a406e-9f21-41eb-9757-83dcef97b590 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lazy-loading 'fault' on Instance uuid 31193401-1445-4200-b186-486852801e52 {{(pid=124133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:35:16.690677 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-d6486dc5-d322-4fdf-b450-f5b1aebb2d30 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:16.691279 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-d6486dc5-d322-4fdf-b450-f5b1aebb2d30 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:16.700283 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d6486dc5-d322-4fdf-b450-f5b1aebb2d30 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:16.701184 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d6486dc5-d322-4fdf-b450-f5b1aebb2d30 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:16.702131 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d6486dc5-d322-4fdf-b450-f5b1aebb2d30 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:16.702720 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d6486dc5-d322-4fdf-b450-f5b1aebb2d30 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:16.734282 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d50a406e-9f21-41eb-9757-83dcef97b590 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:16.743281 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-d50a406e-9f21-41eb-9757-83dcef97b590 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1305 microversion: 2.1 time: 0.133212 May 26 12:35:16.743976 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 234/452] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:16 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1305 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:16.754199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-24b01ab3-3fdd-4364-8e92-12767a1d1a0c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:16.754199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-24b01ab3-3fdd-4364-8e92-12767a1d1a0c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:16.755576 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-24b01ab3-3fdd-4364-8e92-12767a1d1a0c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:16.756029 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-24b01ab3-3fdd-4364-8e92-12767a1d1a0c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:16.757548 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-24b01ab3-3fdd-4364-8e92-12767a1d1a0c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:16.758220 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-24b01ab3-3fdd-4364-8e92-12767a1d1a0c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:16.783348 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-24b01ab3-3fdd-4364-8e92-12767a1d1a0c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Going to try to terminate instance {{(pid=124133) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:35:16.860273 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d6486dc5-d322-4fdf-b450-f5b1aebb2d30 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:16.860549 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-24b01ab3-3fdd-4364-8e92-12767a1d1a0c tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "DELETE /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 204 len: 0 microversion: 2.1 time: 0.115193 May 26 12:35:16.861149 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 235/453] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:35:16 2022] DELETE /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:35:16.869665 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-d6486dc5-d322-4fdf-b450-f5b1aebb2d30 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1360 microversion: 2.1 time: 0.182885 May 26 12:35:16.870386 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 219/454] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:16 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1360 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:16.870638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-0beb0b11-bd7e-4105-b794-3a02cca7ec2a tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:16.871333 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-0beb0b11-bd7e-4105-b794-3a02cca7ec2a tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:16.883895 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0beb0b11-bd7e-4105-b794-3a02cca7ec2a tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:16.883895 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0beb0b11-bd7e-4105-b794-3a02cca7ec2a tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:16.883895 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0beb0b11-bd7e-4105-b794-3a02cca7ec2a tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:16.883895 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0beb0b11-bd7e-4105-b794-3a02cca7ec2a tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:16.971409 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-4a8a7cec-5a12-4268-bb21-545b521a6289 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:16.972018 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-4a8a7cec-5a12-4268-bb21-545b521a6289 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:16.978850 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4a8a7cec-5a12-4268-bb21-545b521a6289 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:16.979300 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4a8a7cec-5a12-4268-bb21-545b521a6289 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:16.980786 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4a8a7cec-5a12-4268-bb21-545b521a6289 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:16.980786 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4a8a7cec-5a12-4268-bb21-545b521a6289 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:17.013681 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-0beb0b11-bd7e-4105-b794-3a02cca7ec2a tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:17.022635 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-0beb0b11-bd7e-4105-b794-3a02cca7ec2a tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1502 microversion: 2.1 time: 0.156708 May 26 12:35:17.023825 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 236/455] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:16 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:17.124450 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-4a8a7cec-5a12-4268-bb21-545b521a6289 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:17.132056 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-4a8a7cec-5a12-4268-bb21-545b521a6289 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1523 microversion: 2.1 time: 0.164512 May 26 12:35:17.132569 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 220/456] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:16 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:17.762159 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ddd007ea-4a87-4933-90e6-0699574d569a tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:17.762763 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ddd007ea-4a87-4933-90e6-0699574d569a tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:17.768825 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ddd007ea-4a87-4933-90e6-0699574d569a tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:17.769280 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ddd007ea-4a87-4933-90e6-0699574d569a tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:17.770039 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ddd007ea-4a87-4933-90e6-0699574d569a tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:17.770478 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ddd007ea-4a87-4933-90e6-0699574d569a tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:17.801703 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ddd007ea-4a87-4933-90e6-0699574d569a tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:17.802153 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ddd007ea-4a87-4933-90e6-0699574d569a tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:17.802630 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.objects.instance [None req-ddd007ea-4a87-4933-90e6-0699574d569a tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lazy-loading 'fault' on Instance uuid 31193401-1445-4200-b186-486852801e52 {{(pid=124133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:35:17.842898 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ddd007ea-4a87-4933-90e6-0699574d569a tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:17.850268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ddd007ea-4a87-4933-90e6-0699574d569a tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1305 microversion: 2.1 time: 0.092136 May 26 12:35:17.850848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 237/457] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:17 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:17.887469 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6213be93-0dbd-4ecd-8c7d-8e2086205f0a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:17.888183 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-6213be93-0dbd-4ecd-8c7d-8e2086205f0a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:17.894570 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6213be93-0dbd-4ecd-8c7d-8e2086205f0a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:17.895025 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6213be93-0dbd-4ecd-8c7d-8e2086205f0a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:17.895784 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6213be93-0dbd-4ecd-8c7d-8e2086205f0a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:17.896224 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6213be93-0dbd-4ecd-8c7d-8e2086205f0a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:18.028042 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-6213be93-0dbd-4ecd-8c7d-8e2086205f0a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:18.035549 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-6213be93-0dbd-4ecd-8c7d-8e2086205f0a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1360 microversion: 2.1 time: 0.152186 May 26 12:35:18.036110 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 221/458] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:17 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:18.042112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-54274300-1633-4011-8525-b7f21b7bce94 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:18.042758 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-54274300-1633-4011-8525-b7f21b7bce94 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:18.048900 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-54274300-1633-4011-8525-b7f21b7bce94 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:18.049349 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-54274300-1633-4011-8525-b7f21b7bce94 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:18.050105 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-54274300-1633-4011-8525-b7f21b7bce94 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:18.050541 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-54274300-1633-4011-8525-b7f21b7bce94 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:18.149114 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6ed2660f-cbfc-432d-afee-583ae7070590 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:18.149722 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-6ed2660f-cbfc-432d-afee-583ae7070590 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:18.156330 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6ed2660f-cbfc-432d-afee-583ae7070590 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:18.156851 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6ed2660f-cbfc-432d-afee-583ae7070590 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:18.157862 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6ed2660f-cbfc-432d-afee-583ae7070590 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:18.158326 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6ed2660f-cbfc-432d-afee-583ae7070590 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:18.191027 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-54274300-1633-4011-8525-b7f21b7bce94 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:18.199174 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-54274300-1633-4011-8525-b7f21b7bce94 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1502 microversion: 2.1 time: 0.160867 May 26 12:35:18.199749 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 238/459] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:18 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:18.285220 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-6ed2660f-cbfc-432d-afee-583ae7070590 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:18.292633 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-6ed2660f-cbfc-432d-afee-583ae7070590 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1523 microversion: 2.1 time: 0.148083 May 26 12:35:18.293232 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 222/460] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:18 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:18.871604 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-aa6438fe-5f1f-416e-82b4-39b024fe34c7 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:18.872301 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-aa6438fe-5f1f-416e-82b4-39b024fe34c7 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:18.881156 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-aa6438fe-5f1f-416e-82b4-39b024fe34c7 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:18.881645 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-aa6438fe-5f1f-416e-82b4-39b024fe34c7 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:18.882500 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-aa6438fe-5f1f-416e-82b4-39b024fe34c7 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:18.882941 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-aa6438fe-5f1f-416e-82b4-39b024fe34c7 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:18.914101 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-aa6438fe-5f1f-416e-82b4-39b024fe34c7 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:18.914546 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-aa6438fe-5f1f-416e-82b4-39b024fe34c7 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:18.914987 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.objects.instance [None req-aa6438fe-5f1f-416e-82b4-39b024fe34c7 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lazy-loading 'fault' on Instance uuid 31193401-1445-4200-b186-486852801e52 {{(pid=124133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:35:18.957062 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-aa6438fe-5f1f-416e-82b4-39b024fe34c7 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:18.965205 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-aa6438fe-5f1f-416e-82b4-39b024fe34c7 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1305 microversion: 2.1 time: 0.101342 May 26 12:35:18.965761 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 239/461] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:18 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:19.051163 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-46789f87-7190-4da2-83bc-30a10827324f tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:19.051703 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-46789f87-7190-4da2-83bc-30a10827324f tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:19.059029 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-46789f87-7190-4da2-83bc-30a10827324f tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:19.059483 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-46789f87-7190-4da2-83bc-30a10827324f tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:19.060267 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-46789f87-7190-4da2-83bc-30a10827324f tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:19.060733 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-46789f87-7190-4da2-83bc-30a10827324f tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:19.187666 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-46789f87-7190-4da2-83bc-30a10827324f tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:19.189972 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=100 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:19.196373 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-46789f87-7190-4da2-83bc-30a10827324f tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1360 microversion: 2.1 time: 0.149087 May 26 12:35:19.196973 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 223/462] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:19 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1360 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:19.218675 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-def912bc-0165-43d8-92be-5e107d47f1e1 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:19.219297 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-def912bc-0165-43d8-92be-5e107d47f1e1 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:19.226132 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-def912bc-0165-43d8-92be-5e107d47f1e1 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:19.226587 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-def912bc-0165-43d8-92be-5e107d47f1e1 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:19.227357 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-def912bc-0165-43d8-92be-5e107d47f1e1 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:19.227802 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-def912bc-0165-43d8-92be-5e107d47f1e1 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:19.309308 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-14d68ba6-fc17-46fd-bf44-f6b58bf09ca6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:19.309918 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-14d68ba6-fc17-46fd-bf44-f6b58bf09ca6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:19.315953 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-14d68ba6-fc17-46fd-bf44-f6b58bf09ca6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:19.316390 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-14d68ba6-fc17-46fd-bf44-f6b58bf09ca6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:19.317178 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-14d68ba6-fc17-46fd-bf44-f6b58bf09ca6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:19.317617 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-14d68ba6-fc17-46fd-bf44-f6b58bf09ca6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:19.356659 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-def912bc-0165-43d8-92be-5e107d47f1e1 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:19.364464 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-def912bc-0165-43d8-92be-5e107d47f1e1 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1502 microversion: 2.1 time: 0.151870 May 26 12:35:19.365429 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 240/463] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:19 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:19.456471 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-14d68ba6-fc17-46fd-bf44-f6b58bf09ca6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:19.464550 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-14d68ba6-fc17-46fd-bf44-f6b58bf09ca6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1523 microversion: 2.1 time: 0.159012 May 26 12:35:19.465140 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 224/464] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:19 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:19.982113 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-35de37ce-d305-4406-a0b5-adf4576248d3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:19.982726 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-35de37ce-d305-4406-a0b5-adf4576248d3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:19.989201 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-35de37ce-d305-4406-a0b5-adf4576248d3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:19.989657 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-35de37ce-d305-4406-a0b5-adf4576248d3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:19.990445 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-35de37ce-d305-4406-a0b5-adf4576248d3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:19.990899 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-35de37ce-d305-4406-a0b5-adf4576248d3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:20.024457 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-35de37ce-d305-4406-a0b5-adf4576248d3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:20.024936 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-35de37ce-d305-4406-a0b5-adf4576248d3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:20.025469 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.objects.instance [None req-35de37ce-d305-4406-a0b5-adf4576248d3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lazy-loading 'fault' on Instance uuid 31193401-1445-4200-b186-486852801e52 {{(pid=124133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:35:20.065187 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-35de37ce-d305-4406-a0b5-adf4576248d3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:20.067450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:20.075662 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-35de37ce-d305-4406-a0b5-adf4576248d3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1305 microversion: 2.1 time: 0.097443 May 26 12:35:20.076611 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 241/465] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:19 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:20.213712 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-eb845c24-73d4-4c89-86f7-f726401f9bd1 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:20.214321 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-eb845c24-73d4-4c89-86f7-f726401f9bd1 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:20.220767 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-eb845c24-73d4-4c89-86f7-f726401f9bd1 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:20.221218 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-eb845c24-73d4-4c89-86f7-f726401f9bd1 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:20.221970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-eb845c24-73d4-4c89-86f7-f726401f9bd1 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:20.222406 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-eb845c24-73d4-4c89-86f7-f726401f9bd1 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:20.346645 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-eb845c24-73d4-4c89-86f7-f726401f9bd1 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:20.354275 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-eb845c24-73d4-4c89-86f7-f726401f9bd1 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1360 microversion: 2.1 time: 0.145002 May 26 12:35:20.354822 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 225/466] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:20 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1360 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:20.382388 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f967d4eb-5748-4fe9-b529-d675781ff7f2 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:20.382990 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f967d4eb-5748-4fe9-b529-d675781ff7f2 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:20.390415 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f967d4eb-5748-4fe9-b529-d675781ff7f2 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:20.390862 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f967d4eb-5748-4fe9-b529-d675781ff7f2 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:20.391657 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f967d4eb-5748-4fe9-b529-d675781ff7f2 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:20.392089 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f967d4eb-5748-4fe9-b529-d675781ff7f2 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:20.482024 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-d0dc60dd-391e-4461-9ccf-6a3046d7add3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:20.482627 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-d0dc60dd-391e-4461-9ccf-6a3046d7add3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:20.488493 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d0dc60dd-391e-4461-9ccf-6a3046d7add3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:20.488970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d0dc60dd-391e-4461-9ccf-6a3046d7add3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:20.489727 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d0dc60dd-391e-4461-9ccf-6a3046d7add3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:20.490161 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d0dc60dd-391e-4461-9ccf-6a3046d7add3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:20.522079 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f967d4eb-5748-4fe9-b529-d675781ff7f2 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:20.529824 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f967d4eb-5748-4fe9-b529-d675781ff7f2 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1502 microversion: 2.1 time: 0.151806 May 26 12:35:20.530480 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 242/467] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:20 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:20.619042 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d0dc60dd-391e-4461-9ccf-6a3046d7add3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:20.626406 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-d0dc60dd-391e-4461-9ccf-6a3046d7add3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1523 microversion: 2.1 time: 0.148174 May 26 12:35:20.626990 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 226/468] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:20 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:21.093625 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-8e2049f5-5e69-4323-bce8-08235fa61aec tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:21.094227 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-8e2049f5-5e69-4323-bce8-08235fa61aec tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:21.100696 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8e2049f5-5e69-4323-bce8-08235fa61aec tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:21.101179 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8e2049f5-5e69-4323-bce8-08235fa61aec tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:21.101931 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8e2049f5-5e69-4323-bce8-08235fa61aec tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:21.102366 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8e2049f5-5e69-4323-bce8-08235fa61aec tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:21.133520 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8e2049f5-5e69-4323-bce8-08235fa61aec tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:21.133965 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8e2049f5-5e69-4323-bce8-08235fa61aec tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:21.134412 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.objects.instance [None req-8e2049f5-5e69-4323-bce8-08235fa61aec tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lazy-loading 'fault' on Instance uuid 31193401-1445-4200-b186-486852801e52 {{(pid=124133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:35:21.177359 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-8e2049f5-5e69-4323-bce8-08235fa61aec tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:21.185213 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-8e2049f5-5e69-4323-bce8-08235fa61aec tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1305 microversion: 2.1 time: 0.095624 May 26 12:35:21.185771 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 243/469] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:21 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:21.371927 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-a5604ad4-500a-4e9d-a873-482bef0cd5f4 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:21.372561 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-a5604ad4-500a-4e9d-a873-482bef0cd5f4 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:21.375001 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=100 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:21.380566 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a5604ad4-500a-4e9d-a873-482bef0cd5f4 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:21.381050 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a5604ad4-500a-4e9d-a873-482bef0cd5f4 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:21.382515 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a5604ad4-500a-4e9d-a873-482bef0cd5f4 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:21.382875 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a5604ad4-500a-4e9d-a873-482bef0cd5f4 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:21.514076 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a5604ad4-500a-4e9d-a873-482bef0cd5f4 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:21.521498 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-a5604ad4-500a-4e9d-a873-482bef0cd5f4 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1360 microversion: 2.1 time: 0.153521 May 26 12:35:21.522107 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 227/470] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:21 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1360 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:21.546317 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-a87e5df2-b7f2-4960-80ec-3a358d662d3a tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:21.546935 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-a87e5df2-b7f2-4960-80ec-3a358d662d3a tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:21.552888 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a87e5df2-b7f2-4960-80ec-3a358d662d3a tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:21.554022 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a87e5df2-b7f2-4960-80ec-3a358d662d3a tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:21.554782 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a87e5df2-b7f2-4960-80ec-3a358d662d3a tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:21.555214 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a87e5df2-b7f2-4960-80ec-3a358d662d3a tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:21.643260 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-9cb0875e-3efc-4b4a-a835-96a6a5f7e05d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:21.643868 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-9cb0875e-3efc-4b4a-a835-96a6a5f7e05d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:21.650033 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9cb0875e-3efc-4b4a-a835-96a6a5f7e05d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:21.650546 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9cb0875e-3efc-4b4a-a835-96a6a5f7e05d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:21.651320 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9cb0875e-3efc-4b4a-a835-96a6a5f7e05d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:21.651765 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9cb0875e-3efc-4b4a-a835-96a6a5f7e05d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:21.693990 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-a87e5df2-b7f2-4960-80ec-3a358d662d3a tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:21.694903 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-a87e5df2-b7f2-4960-80ec-3a358d662d3a tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1502 microversion: 2.1 time: 0.152325 May 26 12:35:21.695476 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 244/471] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:21 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:21.789290 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-9cb0875e-3efc-4b4a-a835-96a6a5f7e05d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:21.796529 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-9cb0875e-3efc-4b4a-a835-96a6a5f7e05d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1523 microversion: 2.1 time: 0.157192 May 26 12:35:21.797112 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 228/472] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:21 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:22.202860 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-9884a3b9-2beb-4870-906f-978fe0ed6ff3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:22.203468 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-9884a3b9-2beb-4870-906f-978fe0ed6ff3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:22.209996 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9884a3b9-2beb-4870-906f-978fe0ed6ff3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:22.210557 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9884a3b9-2beb-4870-906f-978fe0ed6ff3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:22.211318 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9884a3b9-2beb-4870-906f-978fe0ed6ff3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:22.211755 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9884a3b9-2beb-4870-906f-978fe0ed6ff3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:22.242424 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9884a3b9-2beb-4870-906f-978fe0ed6ff3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:22.242874 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9884a3b9-2beb-4870-906f-978fe0ed6ff3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:22.243316 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.objects.instance [None req-9884a3b9-2beb-4870-906f-978fe0ed6ff3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lazy-loading 'fault' on Instance uuid 31193401-1445-4200-b186-486852801e52 {{(pid=124133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:35:22.282871 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-9884a3b9-2beb-4870-906f-978fe0ed6ff3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:22.291132 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-9884a3b9-2beb-4870-906f-978fe0ed6ff3 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1305 microversion: 2.1 time: 0.092045 May 26 12:35:22.291696 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 245/473] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:22 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:22.537792 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-ab111f70-dba9-435e-8f58-7a9f1fd48f42 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:22.538396 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-ab111f70-dba9-435e-8f58-7a9f1fd48f42 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:22.544927 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ab111f70-dba9-435e-8f58-7a9f1fd48f42 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:22.545376 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ab111f70-dba9-435e-8f58-7a9f1fd48f42 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:22.546124 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ab111f70-dba9-435e-8f58-7a9f1fd48f42 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:22.546557 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ab111f70-dba9-435e-8f58-7a9f1fd48f42 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:22.675621 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ab111f70-dba9-435e-8f58-7a9f1fd48f42 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:22.683882 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-ab111f70-dba9-435e-8f58-7a9f1fd48f42 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1360 microversion: 2.1 time: 0.149908 May 26 12:35:22.684443 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 229/474] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:22 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1360 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:22.712393 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-4df0ad6f-1049-4506-960d-264a6068c18b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:22.713158 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-4df0ad6f-1049-4506-960d-264a6068c18b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:22.719552 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4df0ad6f-1049-4506-960d-264a6068c18b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:22.720080 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4df0ad6f-1049-4506-960d-264a6068c18b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:22.720948 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4df0ad6f-1049-4506-960d-264a6068c18b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:22.721451 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4df0ad6f-1049-4506-960d-264a6068c18b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:22.813715 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-7b1fd625-739d-4712-b1f6-8f4226daeb03 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:22.814431 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-7b1fd625-739d-4712-b1f6-8f4226daeb03 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:22.821094 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7b1fd625-739d-4712-b1f6-8f4226daeb03 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:22.821631 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7b1fd625-739d-4712-b1f6-8f4226daeb03 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:22.822482 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7b1fd625-739d-4712-b1f6-8f4226daeb03 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:22.823020 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7b1fd625-739d-4712-b1f6-8f4226daeb03 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:22.858074 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-4df0ad6f-1049-4506-960d-264a6068c18b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:22.866295 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-4df0ad6f-1049-4506-960d-264a6068c18b tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1502 microversion: 2.1 time: 0.158250 May 26 12:35:22.866872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 246/475] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:22 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:22.953362 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-7b1fd625-739d-4712-b1f6-8f4226daeb03 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:22.961404 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-7b1fd625-739d-4712-b1f6-8f4226daeb03 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1523 microversion: 2.1 time: 0.151433 May 26 12:35:22.961993 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 230/476] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:22 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:23.307642 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-def3a301-dcaf-4265-9a52-0440c9fcecf5 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:23.308185 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-def3a301-dcaf-4265-9a52-0440c9fcecf5 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:23.314456 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-def3a301-dcaf-4265-9a52-0440c9fcecf5 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:23.314909 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-def3a301-dcaf-4265-9a52-0440c9fcecf5 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:23.315672 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-def3a301-dcaf-4265-9a52-0440c9fcecf5 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:23.316114 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-def3a301-dcaf-4265-9a52-0440c9fcecf5 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:23.347491 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-def3a301-dcaf-4265-9a52-0440c9fcecf5 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:23.348001 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-def3a301-dcaf-4265-9a52-0440c9fcecf5 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:23.348451 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.objects.instance [None req-def3a301-dcaf-4265-9a52-0440c9fcecf5 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lazy-loading 'fault' on Instance uuid 31193401-1445-4200-b186-486852801e52 {{(pid=124133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:35:23.390910 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-def3a301-dcaf-4265-9a52-0440c9fcecf5 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:23.399237 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-def3a301-dcaf-4265-9a52-0440c9fcecf5 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1305 microversion: 2.1 time: 0.095649 May 26 12:35:23.399793 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 247/477] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:23 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:23.700718 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-c0167cea-918d-40d8-a74c-6b8dfe3d7a33 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:23.701368 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-c0167cea-918d-40d8-a74c-6b8dfe3d7a33 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:23.707732 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c0167cea-918d-40d8-a74c-6b8dfe3d7a33 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:23.708177 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c0167cea-918d-40d8-a74c-6b8dfe3d7a33 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:23.708960 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c0167cea-918d-40d8-a74c-6b8dfe3d7a33 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:23.709400 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c0167cea-918d-40d8-a74c-6b8dfe3d7a33 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:23.837679 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c0167cea-918d-40d8-a74c-6b8dfe3d7a33 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:23.844953 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-c0167cea-918d-40d8-a74c-6b8dfe3d7a33 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1360 microversion: 2.1 time: 0.148059 May 26 12:35:23.845508 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 231/478] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:23 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1360 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:23.888066 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f9b1db96-29e6-4fb0-a4fc-f1d7062bbb72 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:23.888066 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f9b1db96-29e6-4fb0-a4fc-f1d7062bbb72 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:23.890859 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f9b1db96-29e6-4fb0-a4fc-f1d7062bbb72 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:23.891154 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f9b1db96-29e6-4fb0-a4fc-f1d7062bbb72 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:23.892108 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f9b1db96-29e6-4fb0-a4fc-f1d7062bbb72 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:23.892666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f9b1db96-29e6-4fb0-a4fc-f1d7062bbb72 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:23.978479 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-c196535a-3f4d-4afd-8432-696ef2fd7c2f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:23.979231 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-c196535a-3f4d-4afd-8432-696ef2fd7c2f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:23.985518 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c196535a-3f4d-4afd-8432-696ef2fd7c2f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:23.985964 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c196535a-3f4d-4afd-8432-696ef2fd7c2f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:23.986729 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c196535a-3f4d-4afd-8432-696ef2fd7c2f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:23.987168 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c196535a-3f4d-4afd-8432-696ef2fd7c2f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:24.021259 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f9b1db96-29e6-4fb0-a4fc-f1d7062bbb72 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:24.028862 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f9b1db96-29e6-4fb0-a4fc-f1d7062bbb72 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1502 microversion: 2.1 time: 0.149615 May 26 12:35:24.029436 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 248/479] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:23 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:24.120966 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c196535a-3f4d-4afd-8432-696ef2fd7c2f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:24.128339 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-c196535a-3f4d-4afd-8432-696ef2fd7c2f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1523 microversion: 2.1 time: 0.154209 May 26 12:35:24.128916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 232/480] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:23 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:24.416592 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-7099d0f0-a80c-4bb5-85f1-0944e5e2520c tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:24.417200 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-7099d0f0-a80c-4bb5-85f1-0944e5e2520c tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:24.423159 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7099d0f0-a80c-4bb5-85f1-0944e5e2520c tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:24.423602 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7099d0f0-a80c-4bb5-85f1-0944e5e2520c tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:24.424353 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7099d0f0-a80c-4bb5-85f1-0944e5e2520c tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:24.424818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7099d0f0-a80c-4bb5-85f1-0944e5e2520c tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:24.454194 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7099d0f0-a80c-4bb5-85f1-0944e5e2520c tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:24.454638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7099d0f0-a80c-4bb5-85f1-0944e5e2520c tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:24.455079 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.objects.instance [None req-7099d0f0-a80c-4bb5-85f1-0944e5e2520c tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lazy-loading 'fault' on Instance uuid 31193401-1445-4200-b186-486852801e52 {{(pid=124133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:35:24.494521 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-7099d0f0-a80c-4bb5-85f1-0944e5e2520c tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed76893bbb4445b9d1455254d7120c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '783419b36f6d446ba0f1ff249bbaea5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:24.501741 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-7099d0f0-a80c-4bb5-85f1-0944e5e2520c tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 200 len: 1305 microversion: 2.1 time: 0.089664 May 26 12:35:24.502285 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 249/481] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:24 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 1305 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:24.862092 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-98c48bf1-4f29-4cff-bd39-6c4b96a92f18 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:24.862695 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-98c48bf1-4f29-4cff-bd39-6c4b96a92f18 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:24.869528 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-98c48bf1-4f29-4cff-bd39-6c4b96a92f18 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:24.869973 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-98c48bf1-4f29-4cff-bd39-6c4b96a92f18 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:24.870731 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-98c48bf1-4f29-4cff-bd39-6c4b96a92f18 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:24.871164 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-98c48bf1-4f29-4cff-bd39-6c4b96a92f18 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:25.010910 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-98c48bf1-4f29-4cff-bd39-6c4b96a92f18 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:25.018517 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-98c48bf1-4f29-4cff-bd39-6c4b96a92f18 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1360 microversion: 2.1 time: 0.160259 May 26 12:35:25.019079 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 233/482] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:24 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1360 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:25.045881 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-2d12e7cb-396b-404c-b671-9c01ab213b08 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:25.046620 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-2d12e7cb-396b-404c-b671-9c01ab213b08 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:25.052866 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2d12e7cb-396b-404c-b671-9c01ab213b08 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:25.053258 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2d12e7cb-396b-404c-b671-9c01ab213b08 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:25.054017 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2d12e7cb-396b-404c-b671-9c01ab213b08 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:25.054557 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2d12e7cb-396b-404c-b671-9c01ab213b08 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:25.145474 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6f95d5f8-486f-4a25-b7f8-a1dacde61216 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:25.146082 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-6f95d5f8-486f-4a25-b7f8-a1dacde61216 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:25.152860 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6f95d5f8-486f-4a25-b7f8-a1dacde61216 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:25.153307 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6f95d5f8-486f-4a25-b7f8-a1dacde61216 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:25.154059 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6f95d5f8-486f-4a25-b7f8-a1dacde61216 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:25.154522 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6f95d5f8-486f-4a25-b7f8-a1dacde61216 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:25.225613 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-2d12e7cb-396b-404c-b671-9c01ab213b08 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:25.233063 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-2d12e7cb-396b-404c-b671-9c01ab213b08 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1502 microversion: 2.1 time: 0.190906 May 26 12:35:25.233624 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 250/483] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:25 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1502 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:25.320190 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-6f95d5f8-486f-4a25-b7f8-a1dacde61216 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:25.327533 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-6f95d5f8-486f-4a25-b7f8-a1dacde61216 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1523 microversion: 2.1 time: 0.185829 May 26 12:35:25.328089 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 234/484] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:25 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:25.518651 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-370c59d4-f575-4bf9-a353-992a6c714051 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:25.519258 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-370c59d4-f575-4bf9-a353-992a6c714051 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] [instance: 31193401-1445-4200-b186-486852801e52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:25.525379 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-370c59d4-f575-4bf9-a353-992a6c714051 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:25.525831 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-370c59d4-f575-4bf9-a353-992a6c714051 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:25.526586 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-370c59d4-f575-4bf9-a353-992a6c714051 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:25.527032 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-370c59d4-f575-4bf9-a353-992a6c714051 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:25.540636 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-370c59d4-f575-4bf9-a353-992a6c714051 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] HTTP exception thrown: Instance 31193401-1445-4200-b186-486852801e52 could not be found. May 26 12:35:25.542254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-370c59d4-f575-4bf9-a353-992a6c714051 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Request method failure captured: May 26 12:35:25.542254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 HTTP/1.1 May 26 12:35:25.542254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:35:25.542254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:35:25.542254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:35:25.542254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:35:25.542254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:35:25.542254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:35:25.542254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:35:25.542254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:35:25.542254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3Pj-3Q42wrjnWQkeTaWXhuPXrhxdViQVtbpkWarM5dw-xQ8rdWGID3yvNiupA2E0LwKcABzrfAXqYz8M7QpMLqH9YyAgmiIIuHPuYlNFrMJmk381d4cY_mcmYgHp8C0BXY-BPSxihuaGamcKScBJTTsYAwsO0YJ4e4rwdQMFV3TRsw May 26 12:35:25.542254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:35:25.542254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:35:25.542254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:35:25.542254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:35:25.542254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:35:25.542254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:35:25.542254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: 783419b36f6d446ba0f1ff249bbaea5a May 26 12:35:25.542254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-VolumesNegativeTest-1726096285 May 26 12:35:25.542254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:35:25.542254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:35:25.543731 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/783419b36f6d446ba0f1ff249bbaea5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_783419b36f6d446ba0f1ff249bbaea5a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/783419b36f6d446ba0f1ff249bbaea5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/783419b36f6d446ba0f1ff249bbaea5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:35:25.543731 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-VolumesNegativeTest-1726096285 May 26 12:35:25.543731 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: 783419b36f6d446ba0f1ff249bbaea5a May 26 12:35:25.543731 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-VolumesNegativeTest-1726096285 May 26 12:35:25.543731 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-VolumesNegativeTest-1726096285-project May 26 12:35:25.543731 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:35:25.543731 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:35:25.543731 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: 9ed76893bbb4445b9d1455254d7120c4 May 26 12:35:25.543731 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-VolumesNegativeTest-1726096285-project May 26 12:35:25.543731 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: > May 26 12:35:25.543731 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Instance 31193401-1445-4200-b186-486852801e52 could not be found. May 26 12:35:25.543731 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': '31193401-1445-4200-b186-486852801e52'} May 26 12:35:25.544634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:35:25.544634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:35:25.544634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:35:25.544634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:35:25.544634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:35:25.544634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:35:25.544634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:35:25.544634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:35:25.544634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:35:25.544634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:35:25.544634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31193401-1445-4200-b186-486852801e52 could not be found. May 26 12:35:25.544634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:35:25.544634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:35:25.544634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:35:25.544634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:35:25.544634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:35:25.544634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:35:25.544634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:35:25.544634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:35:25.544634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:35:25.546110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:35:25.546110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:35:25.546110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:35:25.546110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:35:25.546110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:35:25.546110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:35:25.546110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:35:25.546110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31193401-1445-4200-b186-486852801e52 could not be found. May 26 12:35:25.546110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:35:25.546110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:35:25.546110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:35:25.546110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:35:25.546110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:35:25.546110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:35:25.546110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:35:25.546110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:35:25.546110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31193401-1445-4200-b186-486852801e52 could not be found. May 26 12:35:25.546110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:35:25.547282 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-370c59d4-f575-4bf9-a353-992a6c714051 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] Returning 404 to user: Instance 31193401-1445-4200-b186-486852801e52 could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:35:25.547282 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-370c59d4-f575-4bf9-a353-992a6c714051 tempest-VolumesNegativeTest-1726096285 tempest-VolumesNegativeTest-1726096285-project] 10.222.0.39 "GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52" status: 404 len: 111 microversion: 2.1 time: 0.028886 May 26 12:35:25.547282 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 251/485] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:25 2022] GET /compute/v2.1/servers/31193401-1445-4200-b186-486852801e52 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:35:25.803154 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-2357c14e-a3b8-411a-9cd8-0e3425527a11 req-a8a00d67-3de5-4937-bb5b-4ea37f29f53b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1220de98-5d9e-4c46-937d-52199dd249c3", "name": "network-vif-plugged", "status": "completed", "tag": "d74c1ce6-0777-4077-8c1e-3845bcaf0256"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:35:25.814813 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-2357c14e-a3b8-411a-9cd8-0e3425527a11 req-a8a00d67-3de5-4937-bb5b-4ea37f29f53b service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:25.815272 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-2357c14e-a3b8-411a-9cd8-0e3425527a11 req-a8a00d67-3de5-4937-bb5b-4ea37f29f53b service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:25.828640 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-2357c14e-a3b8-411a-9cd8-0e3425527a11 req-a8a00d67-3de5-4937-bb5b-4ea37f29f53b service nova] Creating event network-vif-plugged:d74c1ce6-0777-4077-8c1e-3845bcaf0256 for instance 1220de98-5d9e-4c46-937d-52199dd249c3 on hv-cinder-81514 May 26 12:35:25.834440 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-2357c14e-a3b8-411a-9cd8-0e3425527a11 req-a8a00d67-3de5-4937-bb5b-4ea37f29f53b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034501 May 26 12:35:25.834634 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 235/486] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:35:26.035857 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-60e90118-d0c5-4c03-b933-9ff35a4a1d2e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:26.036454 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-60e90118-d0c5-4c03-b933-9ff35a4a1d2e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:26.041406 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:26.051670 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-60e90118-d0c5-4c03-b933-9ff35a4a1d2e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:26.052316 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-60e90118-d0c5-4c03-b933-9ff35a4a1d2e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:26.053799 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-60e90118-d0c5-4c03-b933-9ff35a4a1d2e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:26.054720 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-60e90118-d0c5-4c03-b933-9ff35a4a1d2e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:26.130672 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-f2e99a62-7405-4536-9af6-fe0f4b72f9d0 req-938795df-b153-466d-bd6d-a9c1da43af88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50249dcb-fe40-45b9-a40e-07242ec49ca2", "name": "network-vif-deleted", "tag": "66c6c832-2921-4950-a94c-a7d04e78d89d"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:35:26.148881 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-f2e99a62-7405-4536-9af6-fe0f4b72f9d0 req-938795df-b153-466d-bd6d-a9c1da43af88 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:26.150054 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-f2e99a62-7405-4536-9af6-fe0f4b72f9d0 req-938795df-b153-466d-bd6d-a9c1da43af88 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:26.169977 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-f2e99a62-7405-4536-9af6-fe0f4b72f9d0 req-938795df-b153-466d-bd6d-a9c1da43af88 service nova] Creating event network-vif-deleted:66c6c832-2921-4950-a94c-a7d04e78d89d for instance 50249dcb-fe40-45b9-a40e-07242ec49ca2 on hv-cinder-81514 May 26 12:35:26.175633 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-f2e99a62-7405-4536-9af6-fe0f4b72f9d0 req-938795df-b153-466d-bd6d-a9c1da43af88 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050952 May 26 12:35:26.177648 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 236/487] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:35:26.251580 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-06c77195-de5c-434e-a8a6-311e673b311e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:26.252406 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-06c77195-de5c-434e-a8a6-311e673b311e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:26.259038 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-60e90118-d0c5-4c03-b933-9ff35a4a1d2e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:26.259690 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-06c77195-de5c-434e-a8a6-311e673b311e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:26.260242 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-06c77195-de5c-434e-a8a6-311e673b311e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:26.261563 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-06c77195-de5c-434e-a8a6-311e673b311e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:26.262106 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-06c77195-de5c-434e-a8a6-311e673b311e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:26.267706 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-60e90118-d0c5-4c03-b933-9ff35a4a1d2e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1360 microversion: 2.1 time: 0.235664 May 26 12:35:26.268497 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 252/488] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:26 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1360 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:26.335820 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-06c77195-de5c-434e-a8a6-311e673b311e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:26.344611 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-70100c9c-6c23-4924-b7db-2f1dd59b3b3d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:26.345245 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-70100c9c-6c23-4924-b7db-2f1dd59b3b3d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:26.352638 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-06c77195-de5c-434e-a8a6-311e673b311e tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1298 microversion: 2.1 time: 0.105378 May 26 12:35:26.353042 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-70100c9c-6c23-4924-b7db-2f1dd59b3b3d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:26.353749 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-70100c9c-6c23-4924-b7db-2f1dd59b3b3d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:26.355237 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-70100c9c-6c23-4924-b7db-2f1dd59b3b3d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:26.355898 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-70100c9c-6c23-4924-b7db-2f1dd59b3b3d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:26.362186 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 237/489] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:26 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1298 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:26.488226 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-70100c9c-6c23-4924-b7db-2f1dd59b3b3d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:26.497192 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-70100c9c-6c23-4924-b7db-2f1dd59b3b3d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1523 microversion: 2.1 time: 0.156462 May 26 12:35:26.497759 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 253/490] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:26 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:27.285761 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-a510ade2-f4d2-475d-a4ed-1d02447379f3 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:27.286510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-a510ade2-f4d2-475d-a4ed-1d02447379f3 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:27.297170 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a510ade2-f4d2-475d-a4ed-1d02447379f3 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:27.297648 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a510ade2-f4d2-475d-a4ed-1d02447379f3 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:27.298431 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a510ade2-f4d2-475d-a4ed-1d02447379f3 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:27.298917 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a510ade2-f4d2-475d-a4ed-1d02447379f3 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:27.370230 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f2c9c496-96d4-4c2b-9a9d-20ca86e67367 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:27.370843 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f2c9c496-96d4-4c2b-9a9d-20ca86e67367 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:27.377122 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f2c9c496-96d4-4c2b-9a9d-20ca86e67367 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:27.377823 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f2c9c496-96d4-4c2b-9a9d-20ca86e67367 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:27.378656 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f2c9c496-96d4-4c2b-9a9d-20ca86e67367 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:27.379300 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f2c9c496-96d4-4c2b-9a9d-20ca86e67367 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:27.431578 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f2c9c496-96d4-4c2b-9a9d-20ca86e67367 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:27.432025 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f2c9c496-96d4-4c2b-9a9d-20ca86e67367 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:27.432471 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.objects.instance [None req-f2c9c496-96d4-4c2b-9a9d-20ca86e67367 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lazy-loading 'fault' on Instance uuid 50249dcb-fe40-45b9-a40e-07242ec49ca2 {{(pid=124133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:35:27.488366 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f2c9c496-96d4-4c2b-9a9d-20ca86e67367 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:27.496676 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a510ade2-f4d2-475d-a4ed-1d02447379f3 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:27.499642 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f2c9c496-96d4-4c2b-9a9d-20ca86e67367 tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1303 microversion: 2.1 time: 0.132771 May 26 12:35:27.500247 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 254/491] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:27 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1303 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:27.505235 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-a510ade2-f4d2-475d-a4ed-1d02447379f3 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1360 microversion: 2.1 time: 0.223050 May 26 12:35:27.505877 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 238/492] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:27 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1360 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:27.514845 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-0015043e-7af2-489e-a0b7-21d40612c43a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:27.515623 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-0015043e-7af2-489e-a0b7-21d40612c43a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:27.521498 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0015043e-7af2-489e-a0b7-21d40612c43a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:27.521950 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0015043e-7af2-489e-a0b7-21d40612c43a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:27.522813 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0015043e-7af2-489e-a0b7-21d40612c43a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:27.523847 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0015043e-7af2-489e-a0b7-21d40612c43a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:27.655175 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-0015043e-7af2-489e-a0b7-21d40612c43a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:27.662953 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-0015043e-7af2-489e-a0b7-21d40612c43a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1523 microversion: 2.1 time: 0.152141 May 26 12:35:27.663493 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 255/493] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:27 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:28.516611 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-cefeea72-eccf-4cbe-9b88-2f4e2e5fbedb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:28.518084 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-cefeea72-eccf-4cbe-9b88-2f4e2e5fbedb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:28.522352 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-6b09f508-b733-4675-b228-ed02f8a99e57 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:28.523626 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-6b09f508-b733-4675-b228-ed02f8a99e57 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:28.525667 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cefeea72-eccf-4cbe-9b88-2f4e2e5fbedb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:28.526112 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cefeea72-eccf-4cbe-9b88-2f4e2e5fbedb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:28.527078 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cefeea72-eccf-4cbe-9b88-2f4e2e5fbedb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:28.527503 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cefeea72-eccf-4cbe-9b88-2f4e2e5fbedb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:28.531014 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6b09f508-b733-4675-b228-ed02f8a99e57 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:28.531552 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6b09f508-b733-4675-b228-ed02f8a99e57 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:28.532403 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6b09f508-b733-4675-b228-ed02f8a99e57 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:28.532974 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6b09f508-b733-4675-b228-ed02f8a99e57 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:28.564136 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cefeea72-eccf-4cbe-9b88-2f4e2e5fbedb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:28.564590 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cefeea72-eccf-4cbe-9b88-2f4e2e5fbedb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:28.565073 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.objects.instance [None req-cefeea72-eccf-4cbe-9b88-2f4e2e5fbedb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lazy-loading 'fault' on Instance uuid 50249dcb-fe40-45b9-a40e-07242ec49ca2 {{(pid=124134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:35:28.858622 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-cefeea72-eccf-4cbe-9b88-2f4e2e5fbedb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30a4258c6024a7c9ef1fbd694fa9bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1262e1a887bf44b0ae7fa8ac522e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:28.866346 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-cefeea72-eccf-4cbe-9b88-2f4e2e5fbedb tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 200 len: 1303 microversion: 2.1 time: 0.353489 May 26 12:35:28.867644 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 239/494] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:28 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 1303 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:28.872646 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-0902f58b-eba3-441e-8f79-a53e7854032d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:28.873276 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-0902f58b-eba3-441e-8f79-a53e7854032d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:28.879296 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0902f58b-eba3-441e-8f79-a53e7854032d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:28.879747 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0902f58b-eba3-441e-8f79-a53e7854032d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:28.880513 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0902f58b-eba3-441e-8f79-a53e7854032d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:28.880973 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0902f58b-eba3-441e-8f79-a53e7854032d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:28.942938 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-6b09f508-b733-4675-b228-ed02f8a99e57 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:28.954237 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-6b09f508-b733-4675-b228-ed02f8a99e57 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1360 microversion: 2.1 time: 0.435650 May 26 12:35:28.957352 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 256/495] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:28 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1360 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:29.040229 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-0902f58b-eba3-441e-8f79-a53e7854032d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:29.048515 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-0902f58b-eba3-441e-8f79-a53e7854032d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1523 microversion: 2.1 time: 0.179540 May 26 12:35:29.049277 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 240/496] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:28 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:29.890780 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-774c2f74-352c-4ff1-bd8c-aa0b6a9e06be tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:29.892283 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-774c2f74-352c-4ff1-bd8c-aa0b6a9e06be tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] [instance: 50249dcb-fe40-45b9-a40e-07242ec49ca2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:29.903508 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-774c2f74-352c-4ff1-bd8c-aa0b6a9e06be tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:29.903969 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-774c2f74-352c-4ff1-bd8c-aa0b6a9e06be tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:29.904787 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-774c2f74-352c-4ff1-bd8c-aa0b6a9e06be tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:29.905235 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-774c2f74-352c-4ff1-bd8c-aa0b6a9e06be tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:29.919502 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-774c2f74-352c-4ff1-bd8c-aa0b6a9e06be tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] HTTP exception thrown: Instance 50249dcb-fe40-45b9-a40e-07242ec49ca2 could not be found. May 26 12:35:29.921112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-774c2f74-352c-4ff1-bd8c-aa0b6a9e06be tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Request method failure captured: May 26 12:35:29.921112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 HTTP/1.1 May 26 12:35:29.921112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:35:29.921112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:35:29.921112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:35:29.921112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:35:29.921112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:35:29.921112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:35:29.921112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:35:29.921112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:35:29.921112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3OH9knx94-78d8W9X4QCeYg6L1EzZ1oDg-vNvI5HC1WU140YvV7BYtbCe3JcAGk20AahnhTTZV0-HcdUNWI2busM1nfz-wRAEeb8XiMKFHE8D0P-jaoG5PNV0qitlOt066md6wGkSPX8bKiNp7e9K40WUbvjVko1_AZ7HX500pTxMg May 26 12:35:29.921112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:35:29.921112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:35:29.921112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:35:29.921112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:35:29.921112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:35:29.921112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:35:29.921112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: 1262e1a887bf44b0ae7fa8ac522e1250 May 26 12:35:29.921112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-VolumesActionsTest-484881299 May 26 12:35:29.921112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:35:29.921112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:35:29.922638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1262e1a887bf44b0ae7fa8ac522e1250"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1262e1a887bf44b0ae7fa8ac522e1250", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1262e1a887bf44b0ae7fa8ac522e1250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1262e1a887bf44b0ae7fa8ac522e1250"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:35:29.922638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-VolumesActionsTest-484881299 May 26 12:35:29.922638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: 1262e1a887bf44b0ae7fa8ac522e1250 May 26 12:35:29.922638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-VolumesActionsTest-484881299 May 26 12:35:29.922638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-VolumesActionsTest-484881299-project May 26 12:35:29.922638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:35:29.922638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:35:29.922638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: c30a4258c6024a7c9ef1fbd694fa9bfd May 26 12:35:29.922638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-VolumesActionsTest-484881299-project May 26 12:35:29.922638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: > May 26 12:35:29.922638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Instance 50249dcb-fe40-45b9-a40e-07242ec49ca2 could not be found. May 26 12:35:29.922638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': '50249dcb-fe40-45b9-a40e-07242ec49ca2'} May 26 12:35:29.923785 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:35:29.923785 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:35:29.923785 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:35:29.923785 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:35:29.923785 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:35:29.923785 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:35:29.923785 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:35:29.923785 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:35:29.923785 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:35:29.923785 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:35:29.923785 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50249dcb-fe40-45b9-a40e-07242ec49ca2 could not be found. May 26 12:35:29.923785 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:35:29.923785 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:35:29.923785 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:35:29.923785 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:35:29.923785 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:35:29.923785 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:35:29.923785 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:35:29.923785 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:35:29.923785 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:35:29.925611 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:35:29.925611 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:35:29.925611 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:35:29.925611 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:35:29.925611 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:35:29.925611 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:35:29.925611 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:35:29.925611 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50249dcb-fe40-45b9-a40e-07242ec49ca2 could not be found. May 26 12:35:29.925611 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:35:29.925611 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:35:29.925611 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:35:29.925611 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:35:29.925611 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:35:29.925611 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:35:29.925611 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:35:29.925611 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:35:29.925611 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50249dcb-fe40-45b9-a40e-07242ec49ca2 could not be found. May 26 12:35:29.925611 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:35:29.926876 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-774c2f74-352c-4ff1-bd8c-aa0b6a9e06be tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] Returning 404 to user: Instance 50249dcb-fe40-45b9-a40e-07242ec49ca2 could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:35:29.926876 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-774c2f74-352c-4ff1-bd8c-aa0b6a9e06be tempest-VolumesActionsTest-484881299 tempest-VolumesActionsTest-484881299-project] 10.222.0.39 "GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2" status: 404 len: 111 microversion: 2.1 time: 0.037372 May 26 12:35:29.926876 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 257/497] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:29 2022] GET /compute/v2.1/servers/50249dcb-fe40-45b9-a40e-07242ec49ca2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:35:29.972428 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-918c7ee4-37c4-4c61-838c-b9c2eed2022b tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:29.973344 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-918c7ee4-37c4-4c61-838c-b9c2eed2022b tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:29.981631 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-918c7ee4-37c4-4c61-838c-b9c2eed2022b tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:29.982175 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-918c7ee4-37c4-4c61-838c-b9c2eed2022b tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:29.983550 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-918c7ee4-37c4-4c61-838c-b9c2eed2022b tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:29.984057 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-918c7ee4-37c4-4c61-838c-b9c2eed2022b tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:30.002330 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=100 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:30.066033 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-fa0d85fe-49eb-4be8-9643-43740cc94632 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:30.066736 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-fa0d85fe-49eb-4be8-9643-43740cc94632 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:30.073720 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fa0d85fe-49eb-4be8-9643-43740cc94632 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:30.074390 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fa0d85fe-49eb-4be8-9643-43740cc94632 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:30.075665 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fa0d85fe-49eb-4be8-9643-43740cc94632 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:30.076241 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fa0d85fe-49eb-4be8-9643-43740cc94632 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:30.080703 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=100 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:30.306405 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-918c7ee4-37c4-4c61-838c-b9c2eed2022b tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:30.318110 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-918c7ee4-37c4-4c61-838c-b9c2eed2022b tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1546 microversion: 2.1 time: 0.350170 May 26 12:35:30.319032 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 241/498] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:29 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1546 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:30.336774 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-a9dc88f1-b977-4ac1-a066-70cfb744f363 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:30.337498 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-a9dc88f1-b977-4ac1-a066-70cfb744f363 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:30.345359 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a9dc88f1-b977-4ac1-a066-70cfb744f363 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:30.345818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a9dc88f1-b977-4ac1-a066-70cfb744f363 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:30.346725 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a9dc88f1-b977-4ac1-a066-70cfb744f363 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:30.347290 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a9dc88f1-b977-4ac1-a066-70cfb744f363 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:30.391574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-fa0d85fe-49eb-4be8-9643-43740cc94632 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:30.402742 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-fa0d85fe-49eb-4be8-9643-43740cc94632 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1523 microversion: 2.1 time: 0.339591 May 26 12:35:30.403336 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 258/499] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:30 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1523 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:35:30.491891 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-a9dc88f1-b977-4ac1-a066-70cfb744f363 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160222 May 26 12:35:30.500083 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 242/500] 10.222.0.39 () {58 vars in 1274 bytes} [Thu May 26 12:35:30 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3/os-interface => generated 284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:35:31.419763 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-4e04f5a8-a6c1-4637-bdf9-498e5cca0077 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:31.420927 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-4e04f5a8-a6c1-4637-bdf9-498e5cca0077 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:31.426782 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4e04f5a8-a6c1-4637-bdf9-498e5cca0077 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:31.427425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4e04f5a8-a6c1-4637-bdf9-498e5cca0077 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:31.428375 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4e04f5a8-a6c1-4637-bdf9-498e5cca0077 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:31.429095 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4e04f5a8-a6c1-4637-bdf9-498e5cca0077 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:31.464538 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-2f5f6e16-1e44-4ed6-9e5f-f768c2a0eb1f req-1a81e3f9-3146-445f-971d-76f7d3a6698d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1220de98-5d9e-4c46-937d-52199dd249c3", "tag": "d74c1ce6-0777-4077-8c1e-3845bcaf0256"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:35:31.474821 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-2f5f6e16-1e44-4ed6-9e5f-f768c2a0eb1f req-1a81e3f9-3146-445f-971d-76f7d3a6698d service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:31.475545 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-2f5f6e16-1e44-4ed6-9e5f-f768c2a0eb1f req-1a81e3f9-3146-445f-971d-76f7d3a6698d service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:31.506253 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-2f5f6e16-1e44-4ed6-9e5f-f768c2a0eb1f req-1a81e3f9-3146-445f-971d-76f7d3a6698d service nova] Creating event network-changed:d74c1ce6-0777-4077-8c1e-3845bcaf0256 for instance 1220de98-5d9e-4c46-937d-52199dd249c3 on hv-cinder-81514 May 26 12:35:31.516610 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-2f5f6e16-1e44-4ed6-9e5f-f768c2a0eb1f req-1a81e3f9-3146-445f-971d-76f7d3a6698d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057932 May 26 12:35:31.521515 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 243/501] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:35:31.620952 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-4e04f5a8-a6c1-4637-bdf9-498e5cca0077 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:31.628626 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-4e04f5a8-a6c1-4637-bdf9-498e5cca0077 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1523 microversion: 2.1 time: 0.212581 May 26 12:35:31.629220 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 259/502] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:31 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:32.646607 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-7b5e311d-f4c5-4539-954c-b10ff264d02e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:32.647291 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-7b5e311d-f4c5-4539-954c-b10ff264d02e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:32.654276 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7b5e311d-f4c5-4539-954c-b10ff264d02e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:32.654724 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7b5e311d-f4c5-4539-954c-b10ff264d02e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:32.655471 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7b5e311d-f4c5-4539-954c-b10ff264d02e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:32.655907 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7b5e311d-f4c5-4539-954c-b10ff264d02e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:32.787264 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-7b5e311d-f4c5-4539-954c-b10ff264d02e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:32.795510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-7b5e311d-f4c5-4539-954c-b10ff264d02e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1523 microversion: 2.1 time: 0.153923 May 26 12:35:32.796063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 244/503] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:32 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:33.812647 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d95720d3-6838-4127-a5eb-daf5325e5342 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:33.813299 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d95720d3-6838-4127-a5eb-daf5325e5342 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:33.819390 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d95720d3-6838-4127-a5eb-daf5325e5342 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:33.819958 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d95720d3-6838-4127-a5eb-daf5325e5342 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:33.820749 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d95720d3-6838-4127-a5eb-daf5325e5342 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:33.821186 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d95720d3-6838-4127-a5eb-daf5325e5342 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:33.958028 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d95720d3-6838-4127-a5eb-daf5325e5342 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:33.966391 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-d95720d3-6838-4127-a5eb-daf5325e5342 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1523 microversion: 2.1 time: 0.157588 May 26 12:35:33.966949 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 260/504] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:33 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:34.983807 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-a64bfc62-73f7-4347-baab-e813f73a4cfb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:34.984408 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-a64bfc62-73f7-4347-baab-e813f73a4cfb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:34.990786 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a64bfc62-73f7-4347-baab-e813f73a4cfb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:34.991231 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a64bfc62-73f7-4347-baab-e813f73a4cfb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:34.992564 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a64bfc62-73f7-4347-baab-e813f73a4cfb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:34.993095 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a64bfc62-73f7-4347-baab-e813f73a4cfb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:35.124132 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a64bfc62-73f7-4347-baab-e813f73a4cfb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:35.131744 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-a64bfc62-73f7-4347-baab-e813f73a4cfb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1523 microversion: 2.1 time: 0.152305 May 26 12:35:35.132395 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 245/505] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:34 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:36.151565 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-bc460aed-9b40-4b73-b18c-191f3d02a59e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:36.152104 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-bc460aed-9b40-4b73-b18c-191f3d02a59e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:36.158397 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bc460aed-9b40-4b73-b18c-191f3d02a59e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:36.158848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bc460aed-9b40-4b73-b18c-191f3d02a59e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:36.159614 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bc460aed-9b40-4b73-b18c-191f3d02a59e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:36.160057 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bc460aed-9b40-4b73-b18c-191f3d02a59e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:36.293159 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-bc460aed-9b40-4b73-b18c-191f3d02a59e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:36.300527 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-bc460aed-9b40-4b73-b18c-191f3d02a59e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1523 microversion: 2.1 time: 0.153570 May 26 12:35:36.301111 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 261/506] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:36 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:37.318270 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f4206477-bd86-424b-a912-f4410497bca0 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:37.318872 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-f4206477-bd86-424b-a912-f4410497bca0 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:37.325872 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f4206477-bd86-424b-a912-f4410497bca0 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:37.326320 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f4206477-bd86-424b-a912-f4410497bca0 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:37.327075 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f4206477-bd86-424b-a912-f4410497bca0 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:37.327508 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f4206477-bd86-424b-a912-f4410497bca0 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:37.454109 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-f4206477-bd86-424b-a912-f4410497bca0 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:37.461632 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-f4206477-bd86-424b-a912-f4410497bca0 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1523 microversion: 2.1 time: 0.147516 May 26 12:35:37.462181 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 246/507] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:37 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:38.478597 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-b692c3f8-46d4-4c97-a3ff-314605e03ac0 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:38.479212 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-b692c3f8-46d4-4c97-a3ff-314605e03ac0 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:38.485468 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b692c3f8-46d4-4c97-a3ff-314605e03ac0 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:38.485941 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b692c3f8-46d4-4c97-a3ff-314605e03ac0 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:38.486847 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b692c3f8-46d4-4c97-a3ff-314605e03ac0 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:38.487335 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b692c3f8-46d4-4c97-a3ff-314605e03ac0 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:38.621434 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-b692c3f8-46d4-4c97-a3ff-314605e03ac0 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:38.628937 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-b692c3f8-46d4-4c97-a3ff-314605e03ac0 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1523 microversion: 2.1 time: 0.154111 May 26 12:35:38.629493 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 262/508] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:38 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:39.648601 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-46fe3c96-9696-47bd-9ad2-106dc4ed8c3f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:39.649910 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-46fe3c96-9696-47bd-9ad2-106dc4ed8c3f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:39.662175 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-46fe3c96-9696-47bd-9ad2-106dc4ed8c3f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:39.665593 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-46fe3c96-9696-47bd-9ad2-106dc4ed8c3f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:39.666694 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-46fe3c96-9696-47bd-9ad2-106dc4ed8c3f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:39.667814 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-46fe3c96-9696-47bd-9ad2-106dc4ed8c3f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:39.974171 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-46fe3c96-9696-47bd-9ad2-106dc4ed8c3f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:39.985366 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-46fe3c96-9696-47bd-9ad2-106dc4ed8c3f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1523 microversion: 2.1 time: 0.342030 May 26 12:35:39.988938 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 247/509] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:39 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1523 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:41.002671 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ab5f5f9c-085b-43f0-9d95-deef3a186c45 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:41.003415 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ab5f5f9c-085b-43f0-9d95-deef3a186c45 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:41.022840 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ab5f5f9c-085b-43f0-9d95-deef3a186c45 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:41.027421 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ab5f5f9c-085b-43f0-9d95-deef3a186c45 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:41.029014 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ab5f5f9c-085b-43f0-9d95-deef3a186c45 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:41.029512 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ab5f5f9c-085b-43f0-9d95-deef3a186c45 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:41.231619 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ab5f5f9c-085b-43f0-9d95-deef3a186c45 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:41.240992 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ab5f5f9c-085b-43f0-9d95-deef3a186c45 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1523 microversion: 2.1 time: 0.242510 May 26 12:35:41.242359 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 263/510] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:40 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:42.259132 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-189556d1-6e18-48ff-9bf5-8276795c883c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:42.260453 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-189556d1-6e18-48ff-9bf5-8276795c883c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:42.268736 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-189556d1-6e18-48ff-9bf5-8276795c883c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:42.270115 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-189556d1-6e18-48ff-9bf5-8276795c883c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:42.272165 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-189556d1-6e18-48ff-9bf5-8276795c883c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:42.273024 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-189556d1-6e18-48ff-9bf5-8276795c883c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:42.425071 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-189556d1-6e18-48ff-9bf5-8276795c883c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:42.434178 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-189556d1-6e18-48ff-9bf5-8276795c883c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1523 microversion: 2.1 time: 0.179712 May 26 12:35:42.435283 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 248/511] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:42 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:43.454743 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-5df28c94-35b1-4749-a09b-5bfc568dc56e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:43.456100 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-5df28c94-35b1-4749-a09b-5bfc568dc56e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:43.481067 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5df28c94-35b1-4749-a09b-5bfc568dc56e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:43.481672 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5df28c94-35b1-4749-a09b-5bfc568dc56e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:43.482600 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5df28c94-35b1-4749-a09b-5bfc568dc56e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:43.483134 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5df28c94-35b1-4749-a09b-5bfc568dc56e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:43.642777 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-5df28c94-35b1-4749-a09b-5bfc568dc56e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:43.653080 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-5df28c94-35b1-4749-a09b-5bfc568dc56e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1503 microversion: 2.1 time: 0.204843 May 26 12:35:43.653907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 264/512] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:43 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1503 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:43.671764 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f1420c2d-ba4a-45a3-9558-1d7106c20be4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1df23014-e931-431a-9251-7acab2e54576"}} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:35:43.674003 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-f1420c2d-ba4a-45a3-9558-1d7106c20be4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:43.682760 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f1420c2d-ba4a-45a3-9558-1d7106c20be4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:43.683631 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f1420c2d-ba4a-45a3-9558-1d7106c20be4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:43.684694 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f1420c2d-ba4a-45a3-9558-1d7106c20be4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:43.685466 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f1420c2d-ba4a-45a3-9558-1d7106c20be4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:43.716173 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.wsgi [None req-f1420c2d-ba4a-45a3-9558-1d7106c20be4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] HTTP exception thrown: Cannot 'attach_volume' instance 131042dc-6807-4136-b6ed-7aead934b6b2 while it is in vm_state rescued May 26 12:35:43.718666 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f1420c2d-ba4a-45a3-9558-1d7106c20be4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Request method failure captured: May 26 12:35:43.718666 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: request: POST /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2/os-volume_attachments HTTP/1.1 May 26 12:35:43.718666 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept: application/json May 26 12:35:43.718666 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept-Encoding: identity May 26 12:35:43.718666 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Connection: close May 26 12:35:43.718666 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Length: 74 May 26 12:35:43.718666 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Type: application/json May 26 12:35:43.718666 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Host: 10.222.0.39 May 26 12:35:43.718666 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Openstack-System-Scope: None May 26 12:35:43.718666 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: User-Agent: python-urllib3/1.26.9 May 26 12:35:43.718666 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Auth-Token: gAAAAABij3Ntqo6mdEJ8LlroeinMz0Ovwgkcu2R0zXHjrqQCwq-qJ6oPcC8FCHT3hC1bdixJrdJYoCLHstLf6akw5UN-MphCul9GtSUwf9FwmTUfFUAxs8HgSg_WfADTM9Joom-FI-Cefk6wDfus-Tadb14JEb56PeYzGrxEpIbsZQQAobngoa8 May 26 12:35:43.718666 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Id: None May 26 12:35:43.718666 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Name: None May 26 12:35:43.718666 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Identity-Status: Confirmed May 26 12:35:43.718666 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Is-Admin-Project: True May 26 12:35:43.718666 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Id: default May 26 12:35:43.718666 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Name: Default May 26 12:35:43.718666 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Id: d04d37bf7dfc47f3b20a58a3d95c1c2b May 26 12:35:43.718666 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1556240871 May 26 12:35:43.718666 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Role: member,reader May 26 12:35:43.718666 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Roles: member,reader May 26 12:35:43.720394 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d04d37bf7dfc47f3b20a58a3d95c1c2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d04d37bf7dfc47f3b20a58a3d95c1c2b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d04d37bf7dfc47f3b20a58a3d95c1c2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d04d37bf7dfc47f3b20a58a3d95c1c2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:35:43.720394 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1556240871 May 26 12:35:43.720394 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Id: d04d37bf7dfc47f3b20a58a3d95c1c2b May 26 12:35:43.720394 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1556240871 May 26 12:35:43.720394 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User: tempest-ServerRescueNegativeTestJSON-1556240871-project May 26 12:35:43.720394 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Id: default May 26 12:35:43.720394 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Name: Default May 26 12:35:43.720394 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Id: c21602eca99d48d8824c0f5c1693d573 May 26 12:35:43.720394 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1556240871-project May 26 12:35:43.720394 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: May 26 12:35:43.720394 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {"volumeAttachment": {"volumeId": "1df23014-e931-431a-9251-7acab2e54576"}} May 26 12:35:43.720394 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: method: > May 26 12:35:43.721313 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: exception: Cannot 'attach_volume' instance 131042dc-6807-4136-b6ed-7aead934b6b2 while it is in vm_state rescued May 26 12:35:43.721313 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: action_args: {'server_id': '131042dc-6807-4136-b6ed-7aead934b6b2', 'body': {'volumeAttachment': {'volumeId': '1df23014-e931-431a-9251-7acab2e54576'}}} May 26 12:35:43.721313 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:35:43.721313 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:35:43.721313 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 12:35:43.721313 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 12:35:43.721313 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 12:35:43.721313 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 12:35:43.721313 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 12:35:43.721313 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 12:35:43.721313 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 131042dc-6807-4136-b6ed-7aead934b6b2 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 26 12:35:43.721313 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:35:43.721313 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:35:43.721313 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:35:43.721313 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:35:43.721313 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:35:43.721313 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:35:43.721313 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:35:43.721313 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:35:43.722638 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:35:43.722638 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:35:43.722638 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:35:43.722638 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:35:43.722638 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:35:43.722638 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:35:43.722638 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:35:43.722638 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:35:43.722638 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 26 12:35:43.722638 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 12:35:43.722638 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 12:35:43.722638 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 12:35:43.722638 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 131042dc-6807-4136-b6ed-7aead934b6b2 while it is in vm_state rescued May 26 12:35:43.722638 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:35:43.722638 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:35:43.722638 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:35:43.722638 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:35:43.722638 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:35:43.722638 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:35:43.724041 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:35:43.724041 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:35:43.724041 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 131042dc-6807-4136-b6ed-7aead934b6b2 while it is in vm_state rescued May 26 12:35:43.724041 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:35:43.724041 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f1420c2d-ba4a-45a3-9558-1d7106c20be4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Returning 409 to user: Cannot 'attach_volume' instance 131042dc-6807-4136-b6ed-7aead934b6b2 while it is in vm_state rescued {{(pid=124134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:35:43.724041 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-f1420c2d-ba4a-45a3-9558-1d7106c20be4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "POST /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.055909 May 26 12:35:43.724041 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 249/513] 10.222.0.39 () {60 vars in 1322 bytes} [Thu May 26 12:35:43 2022] POST /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2/os-volume_attachments => generated 152 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 26 12:35:43.735151 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-1c3b327d-c64d-4747-8dd3-862c02881efc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:35:43.736487 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-1c3b327d-c64d-4747-8dd3-862c02881efc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:43.744280 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1c3b327d-c64d-4747-8dd3-862c02881efc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:43.744864 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1c3b327d-c64d-4747-8dd3-862c02881efc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:43.745954 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1c3b327d-c64d-4747-8dd3-862c02881efc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:43.746506 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1c3b327d-c64d-4747-8dd3-862c02881efc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:43.830570 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-1c3b327d-c64d-4747-8dd3-862c02881efc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "POST /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2/action" status: 202 len: 0 microversion: 2.1 time: 0.100683 May 26 12:35:43.831951 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 265/514] 10.222.0.39 () {60 vars in 1277 bytes} [Thu May 26 12:35:43 2022] POST /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:35:43.841469 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-fe976e27-25ea-49f2-821c-d42acddcc1c4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:43.842480 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-fe976e27-25ea-49f2-821c-d42acddcc1c4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:43.850339 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fe976e27-25ea-49f2-821c-d42acddcc1c4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:43.851856 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fe976e27-25ea-49f2-821c-d42acddcc1c4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:43.853190 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fe976e27-25ea-49f2-821c-d42acddcc1c4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:43.853853 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fe976e27-25ea-49f2-821c-d42acddcc1c4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:44.140746 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-fe976e27-25ea-49f2-821c-d42acddcc1c4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:44.151174 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-fe976e27-25ea-49f2-821c-d42acddcc1c4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1511 microversion: 2.1 time: 0.314309 May 26 12:35:44.155659 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 250/515] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:43 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1511 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:45.173669 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-aa5d5271-f577-49e3-921c-24a9184a55d7 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:45.174360 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-aa5d5271-f577-49e3-921c-24a9184a55d7 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:45.181327 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-aa5d5271-f577-49e3-921c-24a9184a55d7 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:45.181776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-aa5d5271-f577-49e3-921c-24a9184a55d7 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:45.182528 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-aa5d5271-f577-49e3-921c-24a9184a55d7 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:45.182964 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-aa5d5271-f577-49e3-921c-24a9184a55d7 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:45.320532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-aa5d5271-f577-49e3-921c-24a9184a55d7 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:45.328110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-aa5d5271-f577-49e3-921c-24a9184a55d7 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1511 microversion: 2.1 time: 0.158588 May 26 12:35:45.328677 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 266/516] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:45 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:46.345355 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f7c46928-46c4-4905-974a-e18469f2961f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:46.345892 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-f7c46928-46c4-4905-974a-e18469f2961f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:46.352466 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f7c46928-46c4-4905-974a-e18469f2961f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:46.352954 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f7c46928-46c4-4905-974a-e18469f2961f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:46.353711 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f7c46928-46c4-4905-974a-e18469f2961f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:46.354147 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f7c46928-46c4-4905-974a-e18469f2961f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:46.484410 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-f7c46928-46c4-4905-974a-e18469f2961f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:46.491814 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-f7c46928-46c4-4905-974a-e18469f2961f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1511 microversion: 2.1 time: 0.150391 May 26 12:35:46.492372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 251/517] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:46 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:47.508858 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-a9217a15-dfb3-4189-b0bf-f6e8ea757520 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:47.509472 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-a9217a15-dfb3-4189-b0bf-f6e8ea757520 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:47.515740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a9217a15-dfb3-4189-b0bf-f6e8ea757520 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:47.516221 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a9217a15-dfb3-4189-b0bf-f6e8ea757520 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:47.517026 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a9217a15-dfb3-4189-b0bf-f6e8ea757520 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:47.517467 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a9217a15-dfb3-4189-b0bf-f6e8ea757520 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:47.643401 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-a9217a15-dfb3-4189-b0bf-f6e8ea757520 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:47.652315 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-a9217a15-dfb3-4189-b0bf-f6e8ea757520 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1511 microversion: 2.1 time: 0.147481 May 26 12:35:47.652898 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 267/518] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:47 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1511 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:48.669350 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-755638c6-4c62-47be-9b7e-fbb3144a924f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:48.670785 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-755638c6-4c62-47be-9b7e-fbb3144a924f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:48.678355 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-755638c6-4c62-47be-9b7e-fbb3144a924f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:48.679257 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-755638c6-4c62-47be-9b7e-fbb3144a924f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:48.680481 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-755638c6-4c62-47be-9b7e-fbb3144a924f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:48.681263 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-755638c6-4c62-47be-9b7e-fbb3144a924f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:48.698821 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:35:48.699015 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Thu May 26 12:35:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 (ip 10.222.0.39) !!! May 26 12:35:48.844817 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-755638c6-4c62-47be-9b7e-fbb3144a924f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:48.853566 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-755638c6-4c62-47be-9b7e-fbb3144a924f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1511 microversion: 2.1 time: 0.188353 May 26 12:35:48.854705 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 252/519] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:48 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1511 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:49.877008 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-62b8d701-b01c-450c-a5ea-7a738190765b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:49.877787 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-62b8d701-b01c-450c-a5ea-7a738190765b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:49.884248 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-62b8d701-b01c-450c-a5ea-7a738190765b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:49.884703 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-62b8d701-b01c-450c-a5ea-7a738190765b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:49.886400 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-62b8d701-b01c-450c-a5ea-7a738190765b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:49.887025 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-62b8d701-b01c-450c-a5ea-7a738190765b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:50.044254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-62b8d701-b01c-450c-a5ea-7a738190765b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:50.052854 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-62b8d701-b01c-450c-a5ea-7a738190765b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1511 microversion: 2.1 time: 0.181954 May 26 12:35:50.065159 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 268/520] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:49 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1511 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:51.072091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-fffb7df4-5963-4fa5-8a5c-1a53da667a9b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:51.073452 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-fffb7df4-5963-4fa5-8a5c-1a53da667a9b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:51.090019 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fffb7df4-5963-4fa5-8a5c-1a53da667a9b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:51.090901 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fffb7df4-5963-4fa5-8a5c-1a53da667a9b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:51.092061 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fffb7df4-5963-4fa5-8a5c-1a53da667a9b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:51.092801 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fffb7df4-5963-4fa5-8a5c-1a53da667a9b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:51.292980 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-fffb7df4-5963-4fa5-8a5c-1a53da667a9b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:51.301386 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-fffb7df4-5963-4fa5-8a5c-1a53da667a9b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1511 microversion: 2.1 time: 0.233869 May 26 12:35:51.302119 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 253/521] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:51 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1511 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:52.319602 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-03bda3d8-fae2-4d5c-b724-f04f046a9c57 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:52.320533 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-03bda3d8-fae2-4d5c-b724-f04f046a9c57 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:52.327244 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-03bda3d8-fae2-4d5c-b724-f04f046a9c57 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:52.328050 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-03bda3d8-fae2-4d5c-b724-f04f046a9c57 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:52.329129 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-03bda3d8-fae2-4d5c-b724-f04f046a9c57 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:52.329894 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-03bda3d8-fae2-4d5c-b724-f04f046a9c57 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:52.571746 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-03bda3d8-fae2-4d5c-b724-f04f046a9c57 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:52.580744 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-03bda3d8-fae2-4d5c-b724-f04f046a9c57 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1511 microversion: 2.1 time: 0.265306 May 26 12:35:52.587352 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 269/522] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:52 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1511 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:53.603902 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-5a099785-67a1-4ad7-a792-361e90af56bd tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:53.604512 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-5a099785-67a1-4ad7-a792-361e90af56bd tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:53.607201 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=56 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:53.612887 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5a099785-67a1-4ad7-a792-361e90af56bd tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:53.621165 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5a099785-67a1-4ad7-a792-361e90af56bd tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:53.621165 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5a099785-67a1-4ad7-a792-361e90af56bd tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:53.621165 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5a099785-67a1-4ad7-a792-361e90af56bd tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:53.788515 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-5a099785-67a1-4ad7-a792-361e90af56bd tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:53.796422 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-5a099785-67a1-4ad7-a792-361e90af56bd tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1517 microversion: 2.1 time: 0.196532 May 26 12:35:53.797027 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 254/523] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:53 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1517 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:35:56.305547 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-db73abcb-eded-4afe-b2c8-1e7704975378 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Action: 'create', calling method: .version_select at 0x7fed315f2310>, body: {"keypair": {"name": "tempest-keypair-1329056989", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIXwSTEuCJFtp5CXIyB+r1UqarGLpIPeYX153uNnGMmtrglndMXKcEpulIAQUxjKf31WUpBwi6r2wlS39AGXyI9DDuZiuBOqfAEgGKrbNOnXpkwEczHg70kXvxYP/jKaA=="}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:35:56.313615 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=38 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:56.324993 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-db73abcb-eded-4afe-b2c8-1e7704975378 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Getting quotas for project d04d37bf7dfc47f3b20a58a3d95c1c2b. Resources: {'key_pairs'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:35:56.329534 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-db73abcb-eded-4afe-b2c8-1e7704975378 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Getting quotas for user c21602eca99d48d8824c0f5c1693d573 and project d04d37bf7dfc47f3b20a58a3d95c1c2b. Resources: {'key_pairs'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:35:56.358913 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-db73abcb-eded-4afe-b2c8-1e7704975378 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057560 May 26 12:35:56.360204 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 270/524] 10.222.0.39 () {60 vars in 1158 bytes} [Thu May 26 12:35:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:35:58.220078 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-72a9140c-40f6-4930-873c-9b6570127bae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1979561150", "imageRef": "7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "55df86f9-dea3-4e88-a7f6-b46e44ef14dd"}], "security_groups": [{"name": "tempest-securitygroup--1240396469"}], "key_name": "tempest-keypair-1329056989", "user_data": "}} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:35:58.334988 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.network.neutron [None req-72a9140c-40f6-4930-873c-9b6570127bae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] validate_networks() for [('55df86f9-dea3-4e88-a7f6-b46e44ef14dd', None, None, None, None, None)] {{(pid=124134) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:35:58.773678 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-72a9140c-40f6-4930-873c-9b6570127bae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Flavor limits 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:35:58.774382 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-72a9140c-40f6-4930-873c-9b6570127bae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Image limits 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:35:58.775020 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-72a9140c-40f6-4930-873c-9b6570127bae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Flavor pref 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:35:58.775500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-72a9140c-40f6-4930-873c-9b6570127bae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Image pref 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:35:58.775922 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-72a9140c-40f6-4930-873c-9b6570127bae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:35:58.786588 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-72a9140c-40f6-4930-873c-9b6570127bae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:58.787093 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-72a9140c-40f6-4930-873c-9b6570127bae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:58.788655 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-72a9140c-40f6-4930-873c-9b6570127bae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:58.789319 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-72a9140c-40f6-4930-873c-9b6570127bae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:58.808981 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.quota [None req-72a9140c-40f6-4930-873c-9b6570127bae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Getting quotas for project d04d37bf7dfc47f3b20a58a3d95c1c2b. Resources: {'cores', 'instances', 'ram'} {{(pid=124134) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:35:58.813467 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.quota [None req-72a9140c-40f6-4930-873c-9b6570127bae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Getting quotas for user c21602eca99d48d8824c0f5c1693d573 and project d04d37bf7dfc47f3b20a58a3d95c1c2b. Resources: {'cores', 'instances', 'ram'} {{(pid=124134) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:35:58.825943 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-72a9140c-40f6-4930-873c-9b6570127bae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Going to run 1 instances... {{(pid=124134) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:35:58.828505 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-72a9140c-40f6-4930-873c-9b6570127bae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:35:58.884739 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-72a9140c-40f6-4930-873c-9b6570127bae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.669451 May 26 12:35:58.886276 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 255/525] 10.222.0.39 () {60 vars in 1146 bytes} [Thu May 26 12:35:58 2022] POST /compute/v2.1/servers => generated 409 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:35:58.896806 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-1936124e-37ea-4e23-bd25-50ebdcc5d7bd tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:58.898692 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-1936124e-37ea-4e23-bd25-50ebdcc5d7bd tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:35:58.989568 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-1936124e-37ea-4e23-bd25-50ebdcc5d7bd tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:35:58.997512 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-1936124e-37ea-4e23-bd25-50ebdcc5d7bd tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1246 microversion: 2.1 time: 0.105285 May 26 12:35:58.998255 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 271/526] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:35:58 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1246 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:36:00.017094 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-3aea98a0-bf97-4b47-9650-584889ad5cd3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:00.018043 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-3aea98a0-bf97-4b47-9650-584889ad5cd3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:00.027290 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3aea98a0-bf97-4b47-9650-584889ad5cd3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:00.028136 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3aea98a0-bf97-4b47-9650-584889ad5cd3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:00.029188 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3aea98a0-bf97-4b47-9650-584889ad5cd3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:00.030367 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3aea98a0-bf97-4b47-9650-584889ad5cd3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:00.036402 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=76 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:00.133087 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-3aea98a0-bf97-4b47-9650-584889ad5cd3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:00.140564 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-3aea98a0-bf97-4b47-9650-584889ad5cd3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1298 microversion: 2.1 time: 0.128313 May 26 12:36:00.141637 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 256/527] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:36:00 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1298 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:36:01.158712 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-b9fa131b-611d-4610-a4d1-4fb3bf2203af tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:01.159414 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-b9fa131b-611d-4610-a4d1-4fb3bf2203af tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:01.166778 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b9fa131b-611d-4610-a4d1-4fb3bf2203af tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:01.167231 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b9fa131b-611d-4610-a4d1-4fb3bf2203af tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:01.167997 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b9fa131b-611d-4610-a4d1-4fb3bf2203af tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:01.168476 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b9fa131b-611d-4610-a4d1-4fb3bf2203af tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:01.171493 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:01.234718 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-b9fa131b-611d-4610-a4d1-4fb3bf2203af tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:01.243264 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-b9fa131b-611d-4610-a4d1-4fb3bf2203af tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1304 microversion: 2.1 time: 0.088327 May 26 12:36:01.243817 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 272/528] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:36:01 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1304 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:36:02.260821 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-317ac74c-e10d-48cc-a2d2-59080816a1b9 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:02.261689 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-317ac74c-e10d-48cc-a2d2-59080816a1b9 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:02.268185 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-317ac74c-e10d-48cc-a2d2-59080816a1b9 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:02.268635 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-317ac74c-e10d-48cc-a2d2-59080816a1b9 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:02.269437 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-317ac74c-e10d-48cc-a2d2-59080816a1b9 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:02.269878 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-317ac74c-e10d-48cc-a2d2-59080816a1b9 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:02.335403 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-317ac74c-e10d-48cc-a2d2-59080816a1b9 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:02.342957 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-317ac74c-e10d-48cc-a2d2-59080816a1b9 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1304 microversion: 2.1 time: 0.086777 May 26 12:36:02.343515 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 257/529] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:36:02 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1304 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:36:03.359655 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ccd5be00-43cf-4000-9f09-5b32b9b10301 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:03.360259 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ccd5be00-43cf-4000-9f09-5b32b9b10301 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:03.366257 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ccd5be00-43cf-4000-9f09-5b32b9b10301 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:03.366699 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ccd5be00-43cf-4000-9f09-5b32b9b10301 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:03.367446 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ccd5be00-43cf-4000-9f09-5b32b9b10301 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:03.367882 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ccd5be00-43cf-4000-9f09-5b32b9b10301 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:03.431592 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ccd5be00-43cf-4000-9f09-5b32b9b10301 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:03.438904 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ccd5be00-43cf-4000-9f09-5b32b9b10301 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1304 microversion: 2.1 time: 0.083167 May 26 12:36:03.439454 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 273/530] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:36:03 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1304 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:36:04.455480 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-218fc905-a72e-4f2a-bb6b-66359de8baae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:04.456087 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-218fc905-a72e-4f2a-bb6b-66359de8baae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:04.462711 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-218fc905-a72e-4f2a-bb6b-66359de8baae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:04.463158 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-218fc905-a72e-4f2a-bb6b-66359de8baae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:04.463918 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-218fc905-a72e-4f2a-bb6b-66359de8baae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:04.464356 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-218fc905-a72e-4f2a-bb6b-66359de8baae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:04.524529 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-218fc905-a72e-4f2a-bb6b-66359de8baae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:04.531813 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-218fc905-a72e-4f2a-bb6b-66359de8baae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1304 microversion: 2.1 time: 0.080251 May 26 12:36:04.532395 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 258/531] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:36:04 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1304 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:36:05.549359 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-8716ca6b-a5b1-4b63-a124-d8aad4f39e43 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:05.549951 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-8716ca6b-a5b1-4b63-a124-d8aad4f39e43 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:05.556293 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8716ca6b-a5b1-4b63-a124-d8aad4f39e43 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:05.556754 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8716ca6b-a5b1-4b63-a124-d8aad4f39e43 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:05.557514 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8716ca6b-a5b1-4b63-a124-d8aad4f39e43 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:05.557948 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8716ca6b-a5b1-4b63-a124-d8aad4f39e43 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:05.641035 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-8716ca6b-a5b1-4b63-a124-d8aad4f39e43 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:05.649476 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-8716ca6b-a5b1-4b63-a124-d8aad4f39e43 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1304 microversion: 2.1 time: 0.103955 May 26 12:36:05.650049 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 274/532] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:36:05 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:36:06.604355 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-b8ce73f5-884c-4f8f-90f9-d5f5f9dce26e req-84767967-23ff-4819-858f-5492140e7a92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c221b67a-627a-485b-9790-4de1b4c73aa3", "tag": "ae3caa21-abd3-4200-9c1d-7ce93b0d6e74"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:36:06.613423 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-b8ce73f5-884c-4f8f-90f9-d5f5f9dce26e req-84767967-23ff-4819-858f-5492140e7a92 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:06.614133 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-b8ce73f5-884c-4f8f-90f9-d5f5f9dce26e req-84767967-23ff-4819-858f-5492140e7a92 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:06.626583 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-b8ce73f5-884c-4f8f-90f9-d5f5f9dce26e req-84767967-23ff-4819-858f-5492140e7a92 service nova] Creating event network-changed:ae3caa21-abd3-4200-9c1d-7ce93b0d6e74 for instance c221b67a-627a-485b-9790-4de1b4c73aa3 on hv-cinder-81514 May 26 12:36:06.632295 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-b8ce73f5-884c-4f8f-90f9-d5f5f9dce26e req-84767967-23ff-4819-858f-5492140e7a92 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032241 May 26 12:36:06.633300 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 259/533] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:36:06.666971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-c39175e2-1669-4232-a0e5-9d3904ff0642 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:06.668331 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-c39175e2-1669-4232-a0e5-9d3904ff0642 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:06.678309 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c39175e2-1669-4232-a0e5-9d3904ff0642 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:06.679190 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c39175e2-1669-4232-a0e5-9d3904ff0642 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:06.680228 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c39175e2-1669-4232-a0e5-9d3904ff0642 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:06.680766 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c39175e2-1669-4232-a0e5-9d3904ff0642 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:06.829618 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-c39175e2-1669-4232-a0e5-9d3904ff0642 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:06.838453 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-c39175e2-1669-4232-a0e5-9d3904ff0642 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1372 microversion: 2.1 time: 0.175599 May 26 12:36:06.842959 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 275/534] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:36:06 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:36:07.856881 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-3cbac0b0-a648-431c-b30e-b2ba70385f00 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:07.857607 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-3cbac0b0-a648-431c-b30e-b2ba70385f00 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:07.863932 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3cbac0b0-a648-431c-b30e-b2ba70385f00 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:07.864377 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3cbac0b0-a648-431c-b30e-b2ba70385f00 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:07.865148 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3cbac0b0-a648-431c-b30e-b2ba70385f00 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:07.866119 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3cbac0b0-a648-431c-b30e-b2ba70385f00 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:08.003258 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-3cbac0b0-a648-431c-b30e-b2ba70385f00 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:08.011740 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-3cbac0b0-a648-431c-b30e-b2ba70385f00 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1372 microversion: 2.1 time: 0.159616 May 26 12:36:08.012304 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 260/535] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:36:07 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:36:09.028798 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-4a9f289e-a69c-4e24-bec4-c52d6e95df46 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:09.029413 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-4a9f289e-a69c-4e24-bec4-c52d6e95df46 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:09.031262 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=6 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:09.036554 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4a9f289e-a69c-4e24-bec4-c52d6e95df46 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:09.037046 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4a9f289e-a69c-4e24-bec4-c52d6e95df46 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:09.037813 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4a9f289e-a69c-4e24-bec4-c52d6e95df46 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:09.038255 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4a9f289e-a69c-4e24-bec4-c52d6e95df46 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:09.165124 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-4a9f289e-a69c-4e24-bec4-c52d6e95df46 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:09.172797 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-4a9f289e-a69c-4e24-bec4-c52d6e95df46 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1372 microversion: 2.1 time: 0.147746 May 26 12:36:09.173368 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 276/536] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:36:09 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1372 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:36:10.189663 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-0f1f56dd-7a71-485a-b52b-66b18cd4e562 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:10.190191 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-0f1f56dd-7a71-485a-b52b-66b18cd4e562 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:10.192114 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell0:SELECT=2 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:10.192791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell0:SELECT=6 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:10.199397 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0f1f56dd-7a71-485a-b52b-66b18cd4e562 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:10.199848 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0f1f56dd-7a71-485a-b52b-66b18cd4e562 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:10.200609 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0f1f56dd-7a71-485a-b52b-66b18cd4e562 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:10.201075 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0f1f56dd-7a71-485a-b52b-66b18cd4e562 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:10.336573 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-0f1f56dd-7a71-485a-b52b-66b18cd4e562 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:10.343900 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-0f1f56dd-7a71-485a-b52b-66b18cd4e562 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1372 microversion: 2.1 time: 0.158156 May 26 12:36:10.344454 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 261/537] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:36:10 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:36:11.360413 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e42b6757-f970-4d9c-b69a-4d410372be65 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:11.361065 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e42b6757-f970-4d9c-b69a-4d410372be65 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:11.367416 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e42b6757-f970-4d9c-b69a-4d410372be65 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:11.367876 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e42b6757-f970-4d9c-b69a-4d410372be65 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:11.368638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e42b6757-f970-4d9c-b69a-4d410372be65 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:11.369111 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e42b6757-f970-4d9c-b69a-4d410372be65 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:11.497077 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e42b6757-f970-4d9c-b69a-4d410372be65 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:11.508346 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e42b6757-f970-4d9c-b69a-4d410372be65 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1372 microversion: 2.1 time: 0.151631 May 26 12:36:11.508977 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 277/538] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:36:11 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:36:12.525907 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6bee06b9-b5eb-443e-8e2f-0a10d6e5f058 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:12.526440 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-6bee06b9-b5eb-443e-8e2f-0a10d6e5f058 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:12.533069 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6bee06b9-b5eb-443e-8e2f-0a10d6e5f058 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:12.533531 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6bee06b9-b5eb-443e-8e2f-0a10d6e5f058 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:12.534298 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6bee06b9-b5eb-443e-8e2f-0a10d6e5f058 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:12.534745 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6bee06b9-b5eb-443e-8e2f-0a10d6e5f058 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:12.680146 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-6bee06b9-b5eb-443e-8e2f-0a10d6e5f058 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:12.687886 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-6bee06b9-b5eb-443e-8e2f-0a10d6e5f058 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1372 microversion: 2.1 time: 0.166429 May 26 12:36:12.694359 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 262/539] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:36:12 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:36:13.713745 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-508e7baa-a3c6-4a23-9eea-c3442abe4bec tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:13.714386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-508e7baa-a3c6-4a23-9eea-c3442abe4bec tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:13.720312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-508e7baa-a3c6-4a23-9eea-c3442abe4bec tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:13.720791 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-508e7baa-a3c6-4a23-9eea-c3442abe4bec tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:13.721627 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-508e7baa-a3c6-4a23-9eea-c3442abe4bec tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:13.722187 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-508e7baa-a3c6-4a23-9eea-c3442abe4bec tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:13.866197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-508e7baa-a3c6-4a23-9eea-c3442abe4bec tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:13.874134 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-508e7baa-a3c6-4a23-9eea-c3442abe4bec tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1372 microversion: 2.1 time: 0.166701 May 26 12:36:13.874703 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 278/540] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:36:13 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:36:14.892397 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-62639769-581d-4be4-8794-4530684937b6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:14.893027 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-62639769-581d-4be4-8794-4530684937b6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:14.900203 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-62639769-581d-4be4-8794-4530684937b6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:14.900829 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-62639769-581d-4be4-8794-4530684937b6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:14.901592 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-62639769-581d-4be4-8794-4530684937b6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:14.902055 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-62639769-581d-4be4-8794-4530684937b6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:15.037498 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-62639769-581d-4be4-8794-4530684937b6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:15.047053 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-62639769-581d-4be4-8794-4530684937b6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1372 microversion: 2.1 time: 0.158608 May 26 12:36:15.047614 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 263/541] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:36:14 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:36:16.065311 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-3533830e-c59c-4666-a89a-aaeddf037a0f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:16.065866 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-3533830e-c59c-4666-a89a-aaeddf037a0f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:16.071893 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3533830e-c59c-4666-a89a-aaeddf037a0f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:16.072343 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3533830e-c59c-4666-a89a-aaeddf037a0f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:16.073130 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3533830e-c59c-4666-a89a-aaeddf037a0f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:16.073568 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3533830e-c59c-4666-a89a-aaeddf037a0f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:16.206192 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-3533830e-c59c-4666-a89a-aaeddf037a0f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:16.214482 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-3533830e-c59c-4666-a89a-aaeddf037a0f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1372 microversion: 2.1 time: 0.153108 May 26 12:36:16.215038 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 279/542] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:36:16 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:36:17.231028 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-13884960-3de5-4c8f-b14b-660b7a7358ae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:17.231629 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-13884960-3de5-4c8f-b14b-660b7a7358ae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:17.238200 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-13884960-3de5-4c8f-b14b-660b7a7358ae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:17.238647 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-13884960-3de5-4c8f-b14b-660b7a7358ae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:17.239399 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-13884960-3de5-4c8f-b14b-660b7a7358ae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:17.239834 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-13884960-3de5-4c8f-b14b-660b7a7358ae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:17.369981 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-13884960-3de5-4c8f-b14b-660b7a7358ae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:17.377479 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-13884960-3de5-4c8f-b14b-660b7a7358ae tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1372 microversion: 2.1 time: 0.150284 May 26 12:36:17.378030 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 264/543] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:36:17 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:36:18.395557 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-46d34e4a-5514-48dd-9695-1dd016749e90 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:18.396206 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-46d34e4a-5514-48dd-9695-1dd016749e90 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:18.403020 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-46d34e4a-5514-48dd-9695-1dd016749e90 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:18.403467 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-46d34e4a-5514-48dd-9695-1dd016749e90 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:18.404494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-46d34e4a-5514-48dd-9695-1dd016749e90 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:18.404978 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-46d34e4a-5514-48dd-9695-1dd016749e90 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:18.536726 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-46d34e4a-5514-48dd-9695-1dd016749e90 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:18.544099 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-46d34e4a-5514-48dd-9695-1dd016749e90 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1372 microversion: 2.1 time: 0.152543 May 26 12:36:18.544662 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 280/544] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:36:18 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:36:19.561283 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-8408e3e6-954a-4c3b-ae0c-e08bf47d3514 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:19.561917 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-8408e3e6-954a-4c3b-ae0c-e08bf47d3514 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:19.568520 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8408e3e6-954a-4c3b-ae0c-e08bf47d3514 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:19.569009 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8408e3e6-954a-4c3b-ae0c-e08bf47d3514 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:19.569786 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8408e3e6-954a-4c3b-ae0c-e08bf47d3514 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:19.570284 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8408e3e6-954a-4c3b-ae0c-e08bf47d3514 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:19.707042 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-8408e3e6-954a-4c3b-ae0c-e08bf47d3514 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:19.715453 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-8408e3e6-954a-4c3b-ae0c-e08bf47d3514 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1372 microversion: 2.1 time: 0.157921 May 26 12:36:19.716014 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 265/545] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:36:19 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:36:20.734079 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f928620b-1549-42d2-b1fa-68d539abe4e6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:20.734769 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f928620b-1549-42d2-b1fa-68d539abe4e6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:20.740850 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f928620b-1549-42d2-b1fa-68d539abe4e6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:20.741323 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f928620b-1549-42d2-b1fa-68d539abe4e6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:20.742074 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f928620b-1549-42d2-b1fa-68d539abe4e6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:20.742544 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f928620b-1549-42d2-b1fa-68d539abe4e6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:20.957903 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f928620b-1549-42d2-b1fa-68d539abe4e6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:20.965651 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f928620b-1549-42d2-b1fa-68d539abe4e6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1372 microversion: 2.1 time: 0.237760 May 26 12:36:20.966203 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 281/546] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:36:20 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1372 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:36:21.983216 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-14575ead-44a5-4499-97f1-65a5246bc578 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:21.983983 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-14575ead-44a5-4499-97f1-65a5246bc578 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:21.990872 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-14575ead-44a5-4499-97f1-65a5246bc578 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:21.991330 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-14575ead-44a5-4499-97f1-65a5246bc578 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:21.992110 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-14575ead-44a5-4499-97f1-65a5246bc578 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:21.992685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-14575ead-44a5-4499-97f1-65a5246bc578 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:22.135396 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-14575ead-44a5-4499-97f1-65a5246bc578 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:22.142954 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-14575ead-44a5-4499-97f1-65a5246bc578 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1372 microversion: 2.1 time: 0.163581 May 26 12:36:22.143505 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 266/547] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:36:21 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:36:23.160345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e432dae7-57d6-4774-b470-7ad68bdd0571 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:23.160967 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e432dae7-57d6-4774-b470-7ad68bdd0571 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:23.167899 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e432dae7-57d6-4774-b470-7ad68bdd0571 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:23.168349 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e432dae7-57d6-4774-b470-7ad68bdd0571 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:23.169207 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e432dae7-57d6-4774-b470-7ad68bdd0571 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:23.169613 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e432dae7-57d6-4774-b470-7ad68bdd0571 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:23.334364 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e432dae7-57d6-4774-b470-7ad68bdd0571 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:23.343451 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e432dae7-57d6-4774-b470-7ad68bdd0571 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1372 microversion: 2.1 time: 0.187730 May 26 12:36:23.344208 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 282/548] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:36:23 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1372 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:36:23.903010 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-a7f1086c-d60b-44f5-aa20-cd31391809f6 req-9aa6e654-b5ff-47ca-addf-be0333338c08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c221b67a-627a-485b-9790-4de1b4c73aa3", "name": "network-vif-plugged", "status": "completed", "tag": "ae3caa21-abd3-4200-9c1d-7ce93b0d6e74"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:36:23.908004 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:23.913625 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-a7f1086c-d60b-44f5-aa20-cd31391809f6 req-9aa6e654-b5ff-47ca-addf-be0333338c08 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:23.914068 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-a7f1086c-d60b-44f5-aa20-cd31391809f6 req-9aa6e654-b5ff-47ca-addf-be0333338c08 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:23.927164 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-a7f1086c-d60b-44f5-aa20-cd31391809f6 req-9aa6e654-b5ff-47ca-addf-be0333338c08 service nova] Creating event network-vif-plugged:ae3caa21-abd3-4200-9c1d-7ce93b0d6e74 for instance c221b67a-627a-485b-9790-4de1b4c73aa3 on hv-cinder-81514 May 26 12:36:23.933914 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-a7f1086c-d60b-44f5-aa20-cd31391809f6 req-9aa6e654-b5ff-47ca-addf-be0333338c08 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035220 May 26 12:36:23.934511 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 267/549] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:36:24.362157 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d067dcbe-55a3-4911-b657-6f75a84901c3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:24.363031 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d067dcbe-55a3-4911-b657-6f75a84901c3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:24.369915 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d067dcbe-55a3-4911-b657-6f75a84901c3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:24.370680 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d067dcbe-55a3-4911-b657-6f75a84901c3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:24.371140 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d067dcbe-55a3-4911-b657-6f75a84901c3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:24.371575 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d067dcbe-55a3-4911-b657-6f75a84901c3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:24.513923 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d067dcbe-55a3-4911-b657-6f75a84901c3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:24.521614 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-d067dcbe-55a3-4911-b657-6f75a84901c3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1372 microversion: 2.1 time: 0.163265 May 26 12:36:24.522237 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 283/550] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:36:24 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:36:25.539651 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-bc7237c6-bbc2-4c99-bc3d-e61259887126 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:25.540568 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-bc7237c6-bbc2-4c99-bc3d-e61259887126 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:25.554289 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bc7237c6-bbc2-4c99-bc3d-e61259887126 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:25.554740 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bc7237c6-bbc2-4c99-bc3d-e61259887126 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:25.555505 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bc7237c6-bbc2-4c99-bc3d-e61259887126 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:25.556443 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bc7237c6-bbc2-4c99-bc3d-e61259887126 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:25.726183 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-bc7237c6-bbc2-4c99-bc3d-e61259887126 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:25.734355 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-bc7237c6-bbc2-4c99-bc3d-e61259887126 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1372 microversion: 2.1 time: 0.199723 May 26 12:36:25.735395 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 268/551] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:36:25 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1372 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:36:26.752934 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-7660d5ec-57b1-4017-856d-050e24e528e2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:26.754435 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-7660d5ec-57b1-4017-856d-050e24e528e2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:26.756409 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:26.765804 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7660d5ec-57b1-4017-856d-050e24e528e2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:26.766444 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7660d5ec-57b1-4017-856d-050e24e528e2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:26.767405 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7660d5ec-57b1-4017-856d-050e24e528e2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:26.767848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7660d5ec-57b1-4017-856d-050e24e528e2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:27.008077 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-7660d5ec-57b1-4017-856d-050e24e528e2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:27.016797 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-7660d5ec-57b1-4017-856d-050e24e528e2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1567 microversion: 2.1 time: 0.267471 May 26 12:36:27.018043 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 284/552] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:36:26 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1567 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:36:27.037626 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-560379f8-daab-4bca-8c22-205640daa4a2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:27.039209 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-560379f8-daab-4bca-8c22-205640daa4a2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:27.061354 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-560379f8-daab-4bca-8c22-205640daa4a2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:27.062257 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-560379f8-daab-4bca-8c22-205640daa4a2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:27.063201 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-560379f8-daab-4bca-8c22-205640daa4a2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:27.063789 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-560379f8-daab-4bca-8c22-205640daa4a2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:27.178188 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-560379f8-daab-4bca-8c22-205640daa4a2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.145736 May 26 12:36:27.178775 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 269/553] 10.222.0.39 () {58 vars in 1274 bytes} [Thu May 26 12:36:27 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3/os-interface => generated 285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:36:28.632726 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-863cd61d-5279-49e2-8800-7814a7697a70 req-80a71bc0-0f4d-492b-ba71-1a2f18038b61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c221b67a-627a-485b-9790-4de1b4c73aa3", "tag": "ae3caa21-abd3-4200-9c1d-7ce93b0d6e74"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:36:28.644087 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-863cd61d-5279-49e2-8800-7814a7697a70 req-80a71bc0-0f4d-492b-ba71-1a2f18038b61 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:28.644739 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-863cd61d-5279-49e2-8800-7814a7697a70 req-80a71bc0-0f4d-492b-ba71-1a2f18038b61 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:28.668150 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-863cd61d-5279-49e2-8800-7814a7697a70 req-80a71bc0-0f4d-492b-ba71-1a2f18038b61 service nova] Creating event network-changed:ae3caa21-abd3-4200-9c1d-7ce93b0d6e74 for instance c221b67a-627a-485b-9790-4de1b4c73aa3 on hv-cinder-81514 May 26 12:36:28.677907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-863cd61d-5279-49e2-8800-7814a7697a70 req-80a71bc0-0f4d-492b-ba71-1a2f18038b61 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049286 May 26 12:36:28.684315 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 285/554] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:36:36.235305 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-d9352839-365a-44d9-8d83-92c55b47531e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Action: 'create', calling method: .version_select at 0x7fed31db43a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1721011571", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7oXADR/4LG00vjABbHFbRgOz67L5CPUsu56ejevf210GsbPcX2wVvlcfqvWkKYWxxyzzIWFpsgF+M0vcu/68PZpRe9zZDJ6xnVRDhLeO2AJVf+iexs3RVlk93RMlIFDg=="}} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:36:36.255540 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.quota [None req-d9352839-365a-44d9-8d83-92c55b47531e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Getting quotas for project ce0de5263b784723aca0332e63f6309e. Resources: {'key_pairs'} {{(pid=124134) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:36:36.261340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.quota [None req-d9352839-365a-44d9-8d83-92c55b47531e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Getting quotas for user a068f31da9dc4b589e649e4ec5cf713f and project ce0de5263b784723aca0332e63f6309e. Resources: {'key_pairs'} {{(pid=124134) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:36:36.340652 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-d9352839-365a-44d9-8d83-92c55b47531e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.268000 May 26 12:36:36.341697 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 270/555] 10.222.0.39 () {60 vars in 1158 bytes} [Thu May 26 12:36:36 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:36:50.719399 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=3 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:50.720142 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=79 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:50.725145 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-bd9748a1-2c58-49b6-b80b-e7486a863454 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:50.725744 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-bd9748a1-2c58-49b6-b80b-e7486a863454 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:50.733578 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bd9748a1-2c58-49b6-b80b-e7486a863454 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:50.734022 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bd9748a1-2c58-49b6-b80b-e7486a863454 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:50.734776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bd9748a1-2c58-49b6-b80b-e7486a863454 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:50.735209 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bd9748a1-2c58-49b6-b80b-e7486a863454 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:50.757991 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-bd9748a1-2c58-49b6-b80b-e7486a863454 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c/ips" status: 200 len: 153 microversion: 2.20 time: 0.039676 May 26 12:36:50.758535 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 286/556] 10.222.0.39 () {60 vars in 1288 bytes} [Thu May 26 12:36:50 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c/ips => generated 153 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:36:53.696027 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=73 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:53.696973 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell0:SELECT=4 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:53.697523 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=1 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:53.702025 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b19acbe8-0484-48bc-968a-ea650f557480 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:36:53.702551 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b19acbe8-0484-48bc-968a-ea650f557480 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:53.711078 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b19acbe8-0484-48bc-968a-ea650f557480 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:53.711524 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b19acbe8-0484-48bc-968a-ea650f557480 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:53.712295 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b19acbe8-0484-48bc-968a-ea650f557480 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:53.712815 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b19acbe8-0484-48bc-968a-ea650f557480 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:53.735658 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.objects.instance [None req-b19acbe8-0484-48bc-968a-ea650f557480 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lazy-loading 'flavor' on Instance uuid 7af16d0b-59c7-43ea-856c-ec79029b680c {{(pid=124134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:36:53.990813 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b19acbe8-0484-48bc-968a-ea650f557480 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "POST /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c/action" status: 202 len: 0 microversion: 2.20 time: 0.295933 May 26 12:36:53.991441 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 271/557] 10.222.0.39 () {62 vars in 1318 bytes} [Thu May 26 12:36:53 2022] POST /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 12:36:54.000242 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e1c7e410-e542-4437-9118-8251d48f1fca tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:54.000906 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e1c7e410-e542-4437-9118-8251d48f1fca tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:54.006968 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e1c7e410-e542-4437-9118-8251d48f1fca tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:54.007428 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e1c7e410-e542-4437-9118-8251d48f1fca tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:54.008196 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e1c7e410-e542-4437-9118-8251d48f1fca tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:54.008702 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e1c7e410-e542-4437-9118-8251d48f1fca tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:54.136239 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e1c7e410-e542-4437-9118-8251d48f1fca tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:54.144735 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e1c7e410-e542-4437-9118-8251d48f1fca tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:54.146249 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e1c7e410-e542-4437-9118-8251d48f1fca tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:54.147422 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e1c7e410-e542-4437-9118-8251d48f1fca tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.151657 May 26 12:36:54.147966 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 287/558] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:36:53 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:36:55.166802 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-852cb61a-fe81-4bf7-ac58-b9fdde78702d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:55.167501 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-852cb61a-fe81-4bf7-ac58-b9fdde78702d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:55.173821 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-852cb61a-fe81-4bf7-ac58-b9fdde78702d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:55.174278 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-852cb61a-fe81-4bf7-ac58-b9fdde78702d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:55.175035 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-852cb61a-fe81-4bf7-ac58-b9fdde78702d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:55.175481 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-852cb61a-fe81-4bf7-ac58-b9fdde78702d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:55.305682 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-852cb61a-fe81-4bf7-ac58-b9fdde78702d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:55.314319 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-852cb61a-fe81-4bf7-ac58-b9fdde78702d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:55.315830 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-852cb61a-fe81-4bf7-ac58-b9fdde78702d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:55.316994 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-852cb61a-fe81-4bf7-ac58-b9fdde78702d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.154960 May 26 12:36:55.317550 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 272/559] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:36:55 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:36:55.581756 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-5c119b30-b70b-4aab-b5fd-ca4831f9664d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:55.582287 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-5c119b30-b70b-4aab-b5fd-ca4831f9664d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:55.588235 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5c119b30-b70b-4aab-b5fd-ca4831f9664d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:55.588678 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5c119b30-b70b-4aab-b5fd-ca4831f9664d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:55.589463 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5c119b30-b70b-4aab-b5fd-ca4831f9664d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:55.591544 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5c119b30-b70b-4aab-b5fd-ca4831f9664d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:55.614581 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-5c119b30-b70b-4aab-b5fd-ca4831f9664d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038/ips" status: 200 len: 151 microversion: 2.1 time: 0.036693 May 26 12:36:55.615321 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 288/560] 10.222.0.39 () {58 vars in 1247 bytes} [Thu May 26 12:36:55 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:36:56.335882 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-8f1c7fc4-57f7-412e-b582-a4f089f633a8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:56.336529 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-8f1c7fc4-57f7-412e-b582-a4f089f633a8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:56.344168 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8f1c7fc4-57f7-412e-b582-a4f089f633a8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:56.344613 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8f1c7fc4-57f7-412e-b582-a4f089f633a8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:56.345424 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8f1c7fc4-57f7-412e-b582-a4f089f633a8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:56.345868 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8f1c7fc4-57f7-412e-b582-a4f089f633a8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:56.479809 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-8f1c7fc4-57f7-412e-b582-a4f089f633a8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:56.488608 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-8f1c7fc4-57f7-412e-b582-a4f089f633a8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:56.490140 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-8f1c7fc4-57f7-412e-b582-a4f089f633a8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:56.492569 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-8f1c7fc4-57f7-412e-b582-a4f089f633a8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.160661 May 26 12:36:56.493196 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 273/561] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:36:56 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:36:57.510816 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-714840bc-cf80-4700-aef8-6fa036792c60 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:57.511709 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-714840bc-cf80-4700-aef8-6fa036792c60 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:57.517755 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-714840bc-cf80-4700-aef8-6fa036792c60 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:57.518208 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-714840bc-cf80-4700-aef8-6fa036792c60 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:57.518966 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-714840bc-cf80-4700-aef8-6fa036792c60 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:57.519403 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-714840bc-cf80-4700-aef8-6fa036792c60 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:57.647543 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-714840bc-cf80-4700-aef8-6fa036792c60 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:57.656733 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-714840bc-cf80-4700-aef8-6fa036792c60 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:57.658230 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-714840bc-cf80-4700-aef8-6fa036792c60 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:57.659365 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-714840bc-cf80-4700-aef8-6fa036792c60 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.152452 May 26 12:36:57.659908 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 289/562] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:36:57 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:36:58.678923 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e10dcedc-47e5-432c-808c-534966c1ae24 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:58.679456 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-e10dcedc-47e5-432c-808c-534966c1ae24 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:58.686271 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e10dcedc-47e5-432c-808c-534966c1ae24 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:58.686714 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e10dcedc-47e5-432c-808c-534966c1ae24 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:58.687465 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e10dcedc-47e5-432c-808c-534966c1ae24 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:58.687899 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e10dcedc-47e5-432c-808c-534966c1ae24 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:58.818789 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-e10dcedc-47e5-432c-808c-534966c1ae24 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:58.826638 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-e10dcedc-47e5-432c-808c-534966c1ae24 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:58.828137 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-e10dcedc-47e5-432c-808c-534966c1ae24 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:58.829301 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-e10dcedc-47e5-432c-808c-534966c1ae24 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.155223 May 26 12:36:58.829853 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 274/563] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:36:58 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:36:59.847197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-7d300907-43b1-4407-8744-fa4419ef27fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:36:59.847808 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-7d300907-43b1-4407-8744-fa4419ef27fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:36:59.853754 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7d300907-43b1-4407-8744-fa4419ef27fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:59.854198 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7d300907-43b1-4407-8744-fa4419ef27fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:59.854948 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7d300907-43b1-4407-8744-fa4419ef27fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:36:59.855410 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7d300907-43b1-4407-8744-fa4419ef27fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:36:59.988658 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-7d300907-43b1-4407-8744-fa4419ef27fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:59.997010 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-7d300907-43b1-4407-8744-fa4419ef27fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:59.998522 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-7d300907-43b1-4407-8744-fa4419ef27fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:36:59.999660 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-7d300907-43b1-4407-8744-fa4419ef27fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.156309 May 26 12:37:00.000203 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 290/564] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:36:59 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:01.018378 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-668ca52c-c63f-4c1e-a0a7-7d211e26e938 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:01.018994 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-668ca52c-c63f-4c1e-a0a7-7d211e26e938 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:01.024962 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-668ca52c-c63f-4c1e-a0a7-7d211e26e938 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:01.025409 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-668ca52c-c63f-4c1e-a0a7-7d211e26e938 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:01.026172 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-668ca52c-c63f-4c1e-a0a7-7d211e26e938 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:01.026600 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-668ca52c-c63f-4c1e-a0a7-7d211e26e938 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:01.167840 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-668ca52c-c63f-4c1e-a0a7-7d211e26e938 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:01.175976 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-668ca52c-c63f-4c1e-a0a7-7d211e26e938 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:01.177601 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-668ca52c-c63f-4c1e-a0a7-7d211e26e938 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:01.178778 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-668ca52c-c63f-4c1e-a0a7-7d211e26e938 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.164459 May 26 12:37:01.179314 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 275/565] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:01 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:02.197018 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-8b6e7643-ab4f-487f-9acb-07f6183e3ab3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:02.198198 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-8b6e7643-ab4f-487f-9acb-07f6183e3ab3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:02.204247 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8b6e7643-ab4f-487f-9acb-07f6183e3ab3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:02.204702 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8b6e7643-ab4f-487f-9acb-07f6183e3ab3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:02.205494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8b6e7643-ab4f-487f-9acb-07f6183e3ab3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:02.205928 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8b6e7643-ab4f-487f-9acb-07f6183e3ab3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:02.227031 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-39e17ddd-81c0-4074-bcd3-e7228e0410bc tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0496d04-3662-4a04-a751-0c45fcec95d7"}} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:02.227031 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-39e17ddd-81c0-4074-bcd3-e7228e0410bc tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:02.231459 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-39e17ddd-81c0-4074-bcd3-e7228e0410bc tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:02.231905 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-39e17ddd-81c0-4074-bcd3-e7228e0410bc tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:02.232668 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-39e17ddd-81c0-4074-bcd3-e7228e0410bc tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:02.233136 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-39e17ddd-81c0-4074-bcd3-e7228e0410bc tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:02.344856 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-8b6e7643-ab4f-487f-9acb-07f6183e3ab3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:02.352964 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-8b6e7643-ab4f-487f-9acb-07f6183e3ab3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:02.354520 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-8b6e7643-ab4f-487f-9acb-07f6183e3ab3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:02.356833 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-8b6e7643-ab4f-487f-9acb-07f6183e3ab3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.163282 May 26 12:37:02.357796 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 291/566] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:02 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:37:02.513584 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-39e17ddd-81c0-4074-bcd3-e7228e0410bc tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "POST /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293966 May 26 12:37:02.514182 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 276/567] 10.222.0.39 () {60 vars in 1322 bytes} [Thu May 26 12:37:02 2022] POST /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:37:03.378313 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-a080890f-08f1-4f5a-a801-e3ded86d92b8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:03.378926 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-a080890f-08f1-4f5a-a801-e3ded86d92b8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:03.385048 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a080890f-08f1-4f5a-a801-e3ded86d92b8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:03.385507 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a080890f-08f1-4f5a-a801-e3ded86d92b8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:03.386520 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a080890f-08f1-4f5a-a801-e3ded86d92b8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:03.386959 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a080890f-08f1-4f5a-a801-e3ded86d92b8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:03.518258 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-a080890f-08f1-4f5a-a801-e3ded86d92b8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:03.526108 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-a080890f-08f1-4f5a-a801-e3ded86d92b8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:03.528557 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-a080890f-08f1-4f5a-a801-e3ded86d92b8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:03.529724 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-a080890f-08f1-4f5a-a801-e3ded86d92b8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.155777 May 26 12:37:03.530270 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 292/568] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:03 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:37:04.549346 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-fe0ba6e1-9fb8-4070-9155-95056cf61af2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:04.550006 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-fe0ba6e1-9fb8-4070-9155-95056cf61af2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:04.556088 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fe0ba6e1-9fb8-4070-9155-95056cf61af2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:04.556537 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fe0ba6e1-9fb8-4070-9155-95056cf61af2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:04.557319 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fe0ba6e1-9fb8-4070-9155-95056cf61af2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:04.557759 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fe0ba6e1-9fb8-4070-9155-95056cf61af2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:04.687978 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-fe0ba6e1-9fb8-4070-9155-95056cf61af2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:04.695989 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-fe0ba6e1-9fb8-4070-9155-95056cf61af2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:04.697592 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-fe0ba6e1-9fb8-4070-9155-95056cf61af2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:04.698793 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-fe0ba6e1-9fb8-4070-9155-95056cf61af2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.154304 May 26 12:37:04.699758 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 277/569] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:04 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:05.718201 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-56966f0f-5c6e-4f7e-8457-7f52eff76a79 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:05.718819 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-56966f0f-5c6e-4f7e-8457-7f52eff76a79 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:05.724679 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-56966f0f-5c6e-4f7e-8457-7f52eff76a79 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:05.725166 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-56966f0f-5c6e-4f7e-8457-7f52eff76a79 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:05.725964 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-56966f0f-5c6e-4f7e-8457-7f52eff76a79 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:05.726410 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-56966f0f-5c6e-4f7e-8457-7f52eff76a79 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:05.858357 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-56966f0f-5c6e-4f7e-8457-7f52eff76a79 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:05.866252 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-56966f0f-5c6e-4f7e-8457-7f52eff76a79 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:05.867776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-56966f0f-5c6e-4f7e-8457-7f52eff76a79 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:05.868950 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-56966f0f-5c6e-4f7e-8457-7f52eff76a79 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.155578 May 26 12:37:05.869506 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 293/570] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:05 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:06.899575 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-5458d8c4-61dd-469e-90ec-af030cfe1ed8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:06.900175 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-5458d8c4-61dd-469e-90ec-af030cfe1ed8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:06.907758 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5458d8c4-61dd-469e-90ec-af030cfe1ed8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:06.908159 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5458d8c4-61dd-469e-90ec-af030cfe1ed8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:06.909026 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5458d8c4-61dd-469e-90ec-af030cfe1ed8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:06.909472 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5458d8c4-61dd-469e-90ec-af030cfe1ed8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:07.057998 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-5458d8c4-61dd-469e-90ec-af030cfe1ed8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:07.065982 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-5458d8c4-61dd-469e-90ec-af030cfe1ed8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:07.067518 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-5458d8c4-61dd-469e-90ec-af030cfe1ed8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:07.068642 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-5458d8c4-61dd-469e-90ec-af030cfe1ed8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.177078 May 26 12:37:07.069211 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 278/571] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:06 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:08.087261 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f0bbe95b-2705-4c0d-9772-f24461d973f9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:08.088058 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f0bbe95b-2705-4c0d-9772-f24461d973f9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:08.094325 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f0bbe95b-2705-4c0d-9772-f24461d973f9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:08.094776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f0bbe95b-2705-4c0d-9772-f24461d973f9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:08.095539 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f0bbe95b-2705-4c0d-9772-f24461d973f9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:08.095978 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f0bbe95b-2705-4c0d-9772-f24461d973f9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:08.229683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f0bbe95b-2705-4c0d-9772-f24461d973f9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:08.239694 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f0bbe95b-2705-4c0d-9772-f24461d973f9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:08.241300 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f0bbe95b-2705-4c0d-9772-f24461d973f9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:08.242441 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f0bbe95b-2705-4c0d-9772-f24461d973f9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.159079 May 26 12:37:08.242972 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 294/572] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:08 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:09.260577 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-21408ab6-52fd-4e8c-9ef4-a303dbfc89a6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:09.261487 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-21408ab6-52fd-4e8c-9ef4-a303dbfc89a6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:09.268591 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-21408ab6-52fd-4e8c-9ef4-a303dbfc89a6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:09.269088 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-21408ab6-52fd-4e8c-9ef4-a303dbfc89a6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:09.269850 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-21408ab6-52fd-4e8c-9ef4-a303dbfc89a6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:09.270289 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-21408ab6-52fd-4e8c-9ef4-a303dbfc89a6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:09.396485 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-21408ab6-52fd-4e8c-9ef4-a303dbfc89a6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:09.404738 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-21408ab6-52fd-4e8c-9ef4-a303dbfc89a6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:09.406292 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-21408ab6-52fd-4e8c-9ef4-a303dbfc89a6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:09.407433 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-21408ab6-52fd-4e8c-9ef4-a303dbfc89a6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.150743 May 26 12:37:09.407987 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 279/573] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:09 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:10.425448 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-b965ca8e-999f-42c7-9a2a-4edb18217a52 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:10.426111 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-b965ca8e-999f-42c7-9a2a-4edb18217a52 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:10.432127 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b965ca8e-999f-42c7-9a2a-4edb18217a52 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:10.432568 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b965ca8e-999f-42c7-9a2a-4edb18217a52 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:10.433352 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b965ca8e-999f-42c7-9a2a-4edb18217a52 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:10.433784 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b965ca8e-999f-42c7-9a2a-4edb18217a52 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:10.569250 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-b965ca8e-999f-42c7-9a2a-4edb18217a52 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:10.580998 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-b965ca8e-999f-42c7-9a2a-4edb18217a52 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:10.582824 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-b965ca8e-999f-42c7-9a2a-4edb18217a52 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:10.584181 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-b965ca8e-999f-42c7-9a2a-4edb18217a52 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.162613 May 26 12:37:10.584748 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 295/574] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:10 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:11.602592 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-5d8227b4-d155-427a-a787-f1ceed54b18e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:11.603109 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-5d8227b4-d155-427a-a787-f1ceed54b18e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:11.609632 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5d8227b4-d155-427a-a787-f1ceed54b18e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:11.610088 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5d8227b4-d155-427a-a787-f1ceed54b18e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:11.610852 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5d8227b4-d155-427a-a787-f1ceed54b18e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:11.611318 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5d8227b4-d155-427a-a787-f1ceed54b18e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:11.743554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-5d8227b4-d155-427a-a787-f1ceed54b18e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:11.751528 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-5d8227b4-d155-427a-a787-f1ceed54b18e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:11.753087 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-5d8227b4-d155-427a-a787-f1ceed54b18e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:11.754232 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-5d8227b4-d155-427a-a787-f1ceed54b18e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.155653 May 26 12:37:11.754788 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 280/575] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:11 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:12.134048 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-2946a5f9-9dc3-455d-8620-880209a35b1b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Action: 'create', calling method: .version_select at 0x7fed315d5dc0>, body: {"keypair": {"name": "tempest-keypair-950477501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMX/HFHwC9WXBLX/FAjpAq0/xH88Rv+Tz3DktEmD/iXnNQcuzmb15WSrpanmkj/fVKXCUr3G0KxPz6ResfuA6/Nizpn0q1v/DmFbTZCt9ZSJyyku36hLOO3hsZJJSDn5uw=="}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:12.148571 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-2946a5f9-9dc3-455d-8620-880209a35b1b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Getting quotas for project 7ef656c0ca2943eb965bf10d4e943d27. Resources: {'key_pairs'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:37:12.152302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-2946a5f9-9dc3-455d-8620-880209a35b1b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Getting quotas for user 7b14606965a74c71881595c71bdd2d58 and project 7ef656c0ca2943eb965bf10d4e943d27. Resources: {'key_pairs'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:37:12.173451 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-2946a5f9-9dc3-455d-8620-880209a35b1b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043202 May 26 12:37:12.174025 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 296/576] 10.222.0.39 () {60 vars in 1158 bytes} [Thu May 26 12:37:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:37:12.775665 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-099ad397-2e69-4cfc-b4ab-04db8efed729 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:12.776292 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-099ad397-2e69-4cfc-b4ab-04db8efed729 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:12.785224 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-099ad397-2e69-4cfc-b4ab-04db8efed729 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:12.785702 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-099ad397-2e69-4cfc-b4ab-04db8efed729 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:12.786481 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-099ad397-2e69-4cfc-b4ab-04db8efed729 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:12.786927 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-099ad397-2e69-4cfc-b4ab-04db8efed729 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:13.002528 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-099ad397-2e69-4cfc-b4ab-04db8efed729 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:13.010474 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-099ad397-2e69-4cfc-b4ab-04db8efed729 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:13.012290 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-099ad397-2e69-4cfc-b4ab-04db8efed729 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:13.014020 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-099ad397-2e69-4cfc-b4ab-04db8efed729 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.242304 May 26 12:37:13.014576 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 281/577] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:12 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:13.575787 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-91dec181-3851-4f38-bc6b-7c414fd59e92 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1829408065", "imageRef": "7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b932a260-099c-4abe-98f7-c68e5fa9337e"}], "security_groups": [{"name": "tempest-securitygroup--1596223927"}], "key_name": "tempest-keypair-950477501", "user_data": "}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:13.679581 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.network.neutron [None req-91dec181-3851-4f38-bc6b-7c414fd59e92 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] validate_networks() for [('b932a260-099c-4abe-98f7-c68e5fa9337e', None, None, None, None, None)] {{(pid=124133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:37:14.031592 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-29197e1a-ac8f-4023-ab2c-f2c297f13e83 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:14.032190 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-29197e1a-ac8f-4023-ab2c-f2c297f13e83 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:14.038609 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-29197e1a-ac8f-4023-ab2c-f2c297f13e83 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:14.039283 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-29197e1a-ac8f-4023-ab2c-f2c297f13e83 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:14.040038 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-29197e1a-ac8f-4023-ab2c-f2c297f13e83 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:14.040470 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-29197e1a-ac8f-4023-ab2c-f2c297f13e83 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:14.041189 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-91dec181-3851-4f38-bc6b-7c414fd59e92 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Flavor limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:37:14.041610 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-91dec181-3851-4f38-bc6b-7c414fd59e92 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Image limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:37:14.042085 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-91dec181-3851-4f38-bc6b-7c414fd59e92 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Flavor pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:37:14.042486 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-91dec181-3851-4f38-bc6b-7c414fd59e92 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Image pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:37:14.042892 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-91dec181-3851-4f38-bc6b-7c414fd59e92 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:37:14.052704 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-91dec181-3851-4f38-bc6b-7c414fd59e92 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:14.053181 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-91dec181-3851-4f38-bc6b-7c414fd59e92 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:14.053973 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-91dec181-3851-4f38-bc6b-7c414fd59e92 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:14.054405 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-91dec181-3851-4f38-bc6b-7c414fd59e92 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:14.071163 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-91dec181-3851-4f38-bc6b-7c414fd59e92 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Getting quotas for project 7ef656c0ca2943eb965bf10d4e943d27. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:37:14.075115 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-91dec181-3851-4f38-bc6b-7c414fd59e92 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Getting quotas for user 7b14606965a74c71881595c71bdd2d58 and project 7ef656c0ca2943eb965bf10d4e943d27. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:37:14.086686 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-91dec181-3851-4f38-bc6b-7c414fd59e92 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Going to run 1 instances... {{(pid=124133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:37:14.088916 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-91dec181-3851-4f38-bc6b-7c414fd59e92 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:37:14.138927 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-91dec181-3851-4f38-bc6b-7c414fd59e92 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.567625 May 26 12:37:14.140099 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 297/578] 10.222.0.39 () {60 vars in 1146 bytes} [Thu May 26 12:37:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:37:14.149707 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e5c03dd9-3c0f-4ad8-9389-3c37a88082ee tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:14.150360 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e5c03dd9-3c0f-4ad8-9389-3c37a88082ee tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:14.195822 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-29197e1a-ac8f-4023-ab2c-f2c297f13e83 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:14.217093 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e5c03dd9-3c0f-4ad8-9389-3c37a88082ee tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:14.218059 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-29197e1a-ac8f-4023-ab2c-f2c297f13e83 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:14.220122 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-29197e1a-ac8f-4023-ab2c-f2c297f13e83 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:14.221348 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-29197e1a-ac8f-4023-ab2c-f2c297f13e83 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.193929 May 26 12:37:14.224810 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 282/579] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:14 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:37:14.225366 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e5c03dd9-3c0f-4ad8-9389-3c37a88082ee tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f" status: 200 len: 1241 microversion: 2.1 time: 0.079461 May 26 12:37:14.226452 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 298/580] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:14 2022] GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:37:15.243423 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-fe75d37d-d8fa-4c95-a10e-4e7126127d8e tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:15.244188 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-fe75d37d-d8fa-4c95-a10e-4e7126127d8e tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:15.248574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f7e4ca1e-773f-40b4-8b81-e8bf12e06ec0 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:15.249220 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f7e4ca1e-773f-40b4-8b81-e8bf12e06ec0 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:15.251785 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fe75d37d-d8fa-4c95-a10e-4e7126127d8e tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:15.252236 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fe75d37d-d8fa-4c95-a10e-4e7126127d8e tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:15.253036 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fe75d37d-d8fa-4c95-a10e-4e7126127d8e tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:15.253551 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fe75d37d-d8fa-4c95-a10e-4e7126127d8e tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:15.256618 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f7e4ca1e-773f-40b4-8b81-e8bf12e06ec0 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:15.257211 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f7e4ca1e-773f-40b4-8b81-e8bf12e06ec0 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:15.258032 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f7e4ca1e-773f-40b4-8b81-e8bf12e06ec0 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:15.258486 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f7e4ca1e-773f-40b4-8b81-e8bf12e06ec0 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:15.346530 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-fe75d37d-d8fa-4c95-a10e-4e7126127d8e tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:15.354144 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-fe75d37d-d8fa-4c95-a10e-4e7126127d8e tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f" status: 200 len: 1245 microversion: 2.1 time: 0.114964 May 26 12:37:15.354724 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 283/581] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:15 2022] GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f => generated 1245 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:15.419132 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f7e4ca1e-773f-40b4-8b81-e8bf12e06ec0 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:15.430839 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f7e4ca1e-773f-40b4-8b81-e8bf12e06ec0 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:15.433406 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f7e4ca1e-773f-40b4-8b81-e8bf12e06ec0 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:15.435161 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f7e4ca1e-773f-40b4-8b81-e8bf12e06ec0 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.191571 May 26 12:37:15.435717 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 299/582] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:15 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:37:16.374121 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-cf517b69-c214-423a-9c90-085dd9eb5ec1 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:16.374764 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-cf517b69-c214-423a-9c90-085dd9eb5ec1 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:16.381131 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cf517b69-c214-423a-9c90-085dd9eb5ec1 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:16.381586 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cf517b69-c214-423a-9c90-085dd9eb5ec1 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:16.382348 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cf517b69-c214-423a-9c90-085dd9eb5ec1 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:16.382788 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cf517b69-c214-423a-9c90-085dd9eb5ec1 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:16.387061 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:16.448806 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-cf517b69-c214-423a-9c90-085dd9eb5ec1 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:16.455263 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-039ab230-7cd4-4997-bc91-1004faa7384a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:16.455878 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-039ab230-7cd4-4997-bc91-1004faa7384a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:16.456845 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-cf517b69-c214-423a-9c90-085dd9eb5ec1 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f" status: 200 len: 1245 microversion: 2.1 time: 0.087122 May 26 12:37:16.461917 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-039ab230-7cd4-4997-bc91-1004faa7384a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:16.462372 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-039ab230-7cd4-4997-bc91-1004faa7384a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:16.463137 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-039ab230-7cd4-4997-bc91-1004faa7384a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:16.463577 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-039ab230-7cd4-4997-bc91-1004faa7384a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:16.466621 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 284/583] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:16 2022] GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f => generated 1245 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:16.594986 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-039ab230-7cd4-4997-bc91-1004faa7384a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:16.602817 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-039ab230-7cd4-4997-bc91-1004faa7384a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:16.604324 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-039ab230-7cd4-4997-bc91-1004faa7384a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:16.605518 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-039ab230-7cd4-4997-bc91-1004faa7384a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.154089 May 26 12:37:16.607243 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 300/584] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:16 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:37:17.473992 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-1c85eee9-4020-4c29-af0f-e55e65dfdb0c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:17.474646 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-1c85eee9-4020-4c29-af0f-e55e65dfdb0c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:17.481267 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1c85eee9-4020-4c29-af0f-e55e65dfdb0c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:17.481811 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1c85eee9-4020-4c29-af0f-e55e65dfdb0c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:17.482655 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1c85eee9-4020-4c29-af0f-e55e65dfdb0c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:17.483095 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1c85eee9-4020-4c29-af0f-e55e65dfdb0c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:17.561658 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-1c85eee9-4020-4c29-af0f-e55e65dfdb0c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:17.569111 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-1c85eee9-4020-4c29-af0f-e55e65dfdb0c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f" status: 200 len: 1299 microversion: 2.1 time: 0.098908 May 26 12:37:17.569786 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 285/585] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:17 2022] GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:17.625185 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-063e0455-3036-4df6-82cf-af023a79ed80 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:17.625717 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-063e0455-3036-4df6-82cf-af023a79ed80 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:17.631694 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-063e0455-3036-4df6-82cf-af023a79ed80 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:17.632145 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-063e0455-3036-4df6-82cf-af023a79ed80 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:17.632940 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-063e0455-3036-4df6-82cf-af023a79ed80 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:17.633380 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-063e0455-3036-4df6-82cf-af023a79ed80 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:17.851115 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-063e0455-3036-4df6-82cf-af023a79ed80 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:17.860762 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-063e0455-3036-4df6-82cf-af023a79ed80 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:17.862414 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-063e0455-3036-4df6-82cf-af023a79ed80 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:17.865614 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-063e0455-3036-4df6-82cf-af023a79ed80 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.245170 May 26 12:37:17.866256 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 301/586] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:17 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:18.586218 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6626b1ac-39b5-425a-85e6-f2893bcd7487 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:18.587000 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-6626b1ac-39b5-425a-85e6-f2893bcd7487 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:18.594818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6626b1ac-39b5-425a-85e6-f2893bcd7487 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:18.595365 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6626b1ac-39b5-425a-85e6-f2893bcd7487 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:18.596242 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6626b1ac-39b5-425a-85e6-f2893bcd7487 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:18.596773 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6626b1ac-39b5-425a-85e6-f2893bcd7487 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:18.868479 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-6626b1ac-39b5-425a-85e6-f2893bcd7487 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:18.876567 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-6626b1ac-39b5-425a-85e6-f2893bcd7487 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f" status: 200 len: 1367 microversion: 2.1 time: 0.294341 May 26 12:37:18.888427 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 286/587] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:18 2022] GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f => generated 1367 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:18.893469 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-3dcd5d64-fa6b-444d-955f-b0dd287e4751 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:18.894076 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-3dcd5d64-fa6b-444d-955f-b0dd287e4751 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:18.900137 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3dcd5d64-fa6b-444d-955f-b0dd287e4751 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:18.900598 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3dcd5d64-fa6b-444d-955f-b0dd287e4751 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:18.901406 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3dcd5d64-fa6b-444d-955f-b0dd287e4751 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:18.901880 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3dcd5d64-fa6b-444d-955f-b0dd287e4751 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:19.122218 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-3dcd5d64-fa6b-444d-955f-b0dd287e4751 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:19.130979 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-3dcd5d64-fa6b-444d-955f-b0dd287e4751 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:19.132512 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-3dcd5d64-fa6b-444d-955f-b0dd287e4751 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:19.134394 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-3dcd5d64-fa6b-444d-955f-b0dd287e4751 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.244278 May 26 12:37:19.137726 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 302/588] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:18 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:19.270483 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-7c93b1ce-46b2-4a54-a585-f21ab55c5f2e req-20be3746-da9b-44a1-aa0b-15282a69efb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "877c410c-52d3-4dcb-b248-61708093ac8f", "tag": "b7d790b4-17d2-4600-ae11-9a7bdeca8da6"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:19.278847 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-7c93b1ce-46b2-4a54-a585-f21ab55c5f2e req-20be3746-da9b-44a1-aa0b-15282a69efb1 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:19.279834 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-7c93b1ce-46b2-4a54-a585-f21ab55c5f2e req-20be3746-da9b-44a1-aa0b-15282a69efb1 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:19.291509 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-7c93b1ce-46b2-4a54-a585-f21ab55c5f2e req-20be3746-da9b-44a1-aa0b-15282a69efb1 service nova] Creating event network-changed:b7d790b4-17d2-4600-ae11-9a7bdeca8da6 for instance 877c410c-52d3-4dcb-b248-61708093ac8f on hv-cinder-81514 May 26 12:37:19.296678 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-7c93b1ce-46b2-4a54-a585-f21ab55c5f2e req-20be3746-da9b-44a1-aa0b-15282a69efb1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029941 May 26 12:37:19.297477 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 287/589] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:37:19.893454 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-547425fe-8866-4816-9da4-ad707b675b53 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:19.894146 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-547425fe-8866-4816-9da4-ad707b675b53 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:19.900257 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-547425fe-8866-4816-9da4-ad707b675b53 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:19.900851 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-547425fe-8866-4816-9da4-ad707b675b53 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:19.901619 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-547425fe-8866-4816-9da4-ad707b675b53 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:19.902064 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-547425fe-8866-4816-9da4-ad707b675b53 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:20.152173 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-547425fe-8866-4816-9da4-ad707b675b53 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:20.158575 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-c678935d-8605-4c49-bcc5-c4001dd21ae1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:20.159477 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-c678935d-8605-4c49-bcc5-c4001dd21ae1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:20.162544 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-547425fe-8866-4816-9da4-ad707b675b53 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f" status: 200 len: 1367 microversion: 2.1 time: 0.272938 May 26 12:37:20.163343 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 303/590] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:19 2022] GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:20.166210 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c678935d-8605-4c49-bcc5-c4001dd21ae1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:20.166742 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c678935d-8605-4c49-bcc5-c4001dd21ae1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:20.167576 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c678935d-8605-4c49-bcc5-c4001dd21ae1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:20.168078 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c678935d-8605-4c49-bcc5-c4001dd21ae1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:20.431143 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c678935d-8605-4c49-bcc5-c4001dd21ae1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:20.440099 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c678935d-8605-4c49-bcc5-c4001dd21ae1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:20.442096 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c678935d-8605-4c49-bcc5-c4001dd21ae1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:20.443070 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-c678935d-8605-4c49-bcc5-c4001dd21ae1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.293742 May 26 12:37:20.443663 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 288/591] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:20 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:37:21.067421 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-035f3e4a-8509-4c77-aca2-015a2d29576c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1417485955", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1721011571", "security_groups": [{"name": "tempest-secgroup-smoke-1181528726"}], "networks": [{"uuid": "3c0beb93-ca6f-40f0-a0ed-d9752ba0cc3c"}], "block_device_mapping_v2": [{"uuid": "ab3b42ba-0948-4dbc-8ca5-6a2cf1bff3a9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:21.076672 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=4 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:21.180650 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.network.neutron [None req-035f3e4a-8509-4c77-aca2-015a2d29576c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] validate_networks() for [('3c0beb93-ca6f-40f0-a0ed-d9752ba0cc3c', None, None, None, None, None)] {{(pid=124133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:37:21.181310 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b1bbc6c5-3a75-41d0-bfe6-ff4ff51a8ee8 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:21.181954 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b1bbc6c5-3a75-41d0-bfe6-ff4ff51a8ee8 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:21.188998 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b1bbc6c5-3a75-41d0-bfe6-ff4ff51a8ee8 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:21.189455 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b1bbc6c5-3a75-41d0-bfe6-ff4ff51a8ee8 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:21.190226 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b1bbc6c5-3a75-41d0-bfe6-ff4ff51a8ee8 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:21.190668 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b1bbc6c5-3a75-41d0-bfe6-ff4ff51a8ee8 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:21.382722 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b1bbc6c5-3a75-41d0-bfe6-ff4ff51a8ee8 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:21.390647 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b1bbc6c5-3a75-41d0-bfe6-ff4ff51a8ee8 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f" status: 200 len: 1367 microversion: 2.1 time: 0.214438 May 26 12:37:21.391311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 289/592] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:21 2022] GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:21.461944 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-3427b25a-5f53-46dc-8111-e8d09255517c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:21.462544 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-3427b25a-5f53-46dc-8111-e8d09255517c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:21.468642 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3427b25a-5f53-46dc-8111-e8d09255517c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:21.469126 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3427b25a-5f53-46dc-8111-e8d09255517c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:21.469885 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3427b25a-5f53-46dc-8111-e8d09255517c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:21.470326 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3427b25a-5f53-46dc-8111-e8d09255517c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:21.674475 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-3427b25a-5f53-46dc-8111-e8d09255517c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:21.682838 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-3427b25a-5f53-46dc-8111-e8d09255517c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:21.685152 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-3427b25a-5f53-46dc-8111-e8d09255517c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:21.686449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-3427b25a-5f53-46dc-8111-e8d09255517c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1746 microversion: 2.20 time: 0.228523 May 26 12:37:21.687012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 290/593] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:21 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1746 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:37:21.693816 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-035f3e4a-8509-4c77-aca2-015a2d29576c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Flavor limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:37:21.694239 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-035f3e4a-8509-4c77-aca2-015a2d29576c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Image limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:37:21.694738 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-035f3e4a-8509-4c77-aca2-015a2d29576c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Flavor pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:37:21.695144 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-035f3e4a-8509-4c77-aca2-015a2d29576c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Image pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:37:21.695556 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-035f3e4a-8509-4c77-aca2-015a2d29576c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:37:21.705505 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-035f3e4a-8509-4c77-aca2-015a2d29576c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:21.705945 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-035f3e4a-8509-4c77-aca2-015a2d29576c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:21.706730 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-035f3e4a-8509-4c77-aca2-015a2d29576c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:21.707191 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-035f3e4a-8509-4c77-aca2-015a2d29576c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:21.714479 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=89 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:21.726019 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-035f3e4a-8509-4c77-aca2-015a2d29576c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Getting quotas for project ce0de5263b784723aca0332e63f6309e. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:37:21.729705 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-035f3e4a-8509-4c77-aca2-015a2d29576c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Getting quotas for user a068f31da9dc4b589e649e4ec5cf713f and project ce0de5263b784723aca0332e63f6309e. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:37:21.787160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-035f3e4a-8509-4c77-aca2-015a2d29576c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Going to run 1 instances... {{(pid=124133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:37:21.789213 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-035f3e4a-8509-4c77-aca2-015a2d29576c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ab3b42ba-0948-4dbc-8ca5-6a2cf1bff3a9',volume_size=None,volume_type=None)] {{(pid=124133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:37:21.918161 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-035f3e4a-8509-4c77-aca2-015a2d29576c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.854475 May 26 12:37:21.919071 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 304/594] 10.222.0.39 () {60 vars in 1146 bytes} [Thu May 26 12:37:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:37:21.928871 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-d9e00db6-f619-42ff-a671-1c49dfdd166b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:21.929473 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-d9e00db6-f619-42ff-a671-1c49dfdd166b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:21.985622 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d9e00db6-f619-42ff-a671-1c49dfdd166b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:21.993394 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-d9e00db6-f619-42ff-a671-1c49dfdd166b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1089 microversion: 2.1 time: 0.068367 May 26 12:37:21.993957 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 291/595] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:21 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1089 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:22.407841 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-cabf68c9-b8ce-4131-bb61-179328d5269b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:22.408466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-cabf68c9-b8ce-4131-bb61-179328d5269b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:22.415675 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cabf68c9-b8ce-4131-bb61-179328d5269b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:22.416176 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cabf68c9-b8ce-4131-bb61-179328d5269b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:22.417003 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cabf68c9-b8ce-4131-bb61-179328d5269b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:22.417453 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cabf68c9-b8ce-4131-bb61-179328d5269b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:22.553494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-cabf68c9-b8ce-4131-bb61-179328d5269b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:22.561213 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-cabf68c9-b8ce-4131-bb61-179328d5269b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f" status: 200 len: 1367 microversion: 2.1 time: 0.157355 May 26 12:37:22.561781 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 305/596] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:22 2022] GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:22.705440 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-aa84f823-bb3f-40a2-a927-30d739fc842e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:22.706063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-aa84f823-bb3f-40a2-a927-30d739fc842e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:22.713195 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-aa84f823-bb3f-40a2-a927-30d739fc842e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:22.713638 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-aa84f823-bb3f-40a2-a927-30d739fc842e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:22.714400 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-aa84f823-bb3f-40a2-a927-30d739fc842e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:22.714838 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-aa84f823-bb3f-40a2-a927-30d739fc842e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:22.843853 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-aa84f823-bb3f-40a2-a927-30d739fc842e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:22.851798 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-aa84f823-bb3f-40a2-a927-30d739fc842e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:22.853360 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-aa84f823-bb3f-40a2-a927-30d739fc842e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:22.854505 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-aa84f823-bb3f-40a2-a927-30d739fc842e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1746 microversion: 2.20 time: 0.153092 May 26 12:37:22.855080 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 292/597] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:22 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:37:23.010825 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f1f46956-46c9-4754-ac62-23f86327fc95 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:23.011694 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f1f46956-46c9-4754-ac62-23f86327fc95 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:23.018430 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f1f46956-46c9-4754-ac62-23f86327fc95 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:23.018884 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f1f46956-46c9-4754-ac62-23f86327fc95 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:23.019636 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f1f46956-46c9-4754-ac62-23f86327fc95 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:23.020078 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f1f46956-46c9-4754-ac62-23f86327fc95 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:23.083484 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f1f46956-46c9-4754-ac62-23f86327fc95 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:23.091552 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f1f46956-46c9-4754-ac62-23f86327fc95 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1139 microversion: 2.1 time: 0.084503 May 26 12:37:23.092084 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 306/598] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:23 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:23.578088 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-4dc9944a-cddb-4c71-8808-7b05034972bf tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:23.578700 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-4dc9944a-cddb-4c71-8808-7b05034972bf tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:23.584739 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4dc9944a-cddb-4c71-8808-7b05034972bf tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:23.585204 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4dc9944a-cddb-4c71-8808-7b05034972bf tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:23.585972 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4dc9944a-cddb-4c71-8808-7b05034972bf tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:23.586418 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4dc9944a-cddb-4c71-8808-7b05034972bf tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:23.715390 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-4dc9944a-cddb-4c71-8808-7b05034972bf tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:23.722778 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-4dc9944a-cddb-4c71-8808-7b05034972bf tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f" status: 200 len: 1367 microversion: 2.1 time: 0.148603 May 26 12:37:23.723356 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 293/599] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:23 2022] GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:23.873733 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-38fd0573-849b-4dcf-bf02-9661ee745e91 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:23.874259 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-38fd0573-849b-4dcf-bf02-9661ee745e91 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:23.880371 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-38fd0573-849b-4dcf-bf02-9661ee745e91 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:23.880856 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-38fd0573-849b-4dcf-bf02-9661ee745e91 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:23.881629 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-38fd0573-849b-4dcf-bf02-9661ee745e91 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:23.882076 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-38fd0573-849b-4dcf-bf02-9661ee745e91 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:24.008365 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-38fd0573-849b-4dcf-bf02-9661ee745e91 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:24.016679 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-38fd0573-849b-4dcf-bf02-9661ee745e91 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:24.018201 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-38fd0573-849b-4dcf-bf02-9661ee745e91 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:24.019336 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-38fd0573-849b-4dcf-bf02-9661ee745e91 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1746 microversion: 2.20 time: 0.150534 May 26 12:37:24.019880 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 307/600] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:23 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:24.109234 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-ceaf1122-46a0-4158-bceb-fe4a2cd4ce91 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:24.109904 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-ceaf1122-46a0-4158-bceb-fe4a2cd4ce91 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:24.112018 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=49 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:24.117501 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ceaf1122-46a0-4158-bceb-fe4a2cd4ce91 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:24.117957 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ceaf1122-46a0-4158-bceb-fe4a2cd4ce91 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:24.118718 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ceaf1122-46a0-4158-bceb-fe4a2cd4ce91 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:24.119160 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ceaf1122-46a0-4158-bceb-fe4a2cd4ce91 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:24.186628 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ceaf1122-46a0-4158-bceb-fe4a2cd4ce91 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:24.194072 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-ceaf1122-46a0-4158-bceb-fe4a2cd4ce91 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1139 microversion: 2.1 time: 0.089566 May 26 12:37:24.194628 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 294/601] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:24 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1139 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:24.568147 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-a8876e2b-15bd-49a2-8b46-b2fe60ec225f req-e20fbf01-47e6-493e-b406-ee171d094f1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7af16d0b-59c7-43ea-856c-ec79029b680c", "name": "network-vif-plugged", "status": "completed", "tag": "b1b5ee45-e743-4819-bc49-534e21eec9a7"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:24.578341 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-a8876e2b-15bd-49a2-8b46-b2fe60ec225f req-e20fbf01-47e6-493e-b406-ee171d094f1c service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:24.579001 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-a8876e2b-15bd-49a2-8b46-b2fe60ec225f req-e20fbf01-47e6-493e-b406-ee171d094f1c service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:24.595362 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-a8876e2b-15bd-49a2-8b46-b2fe60ec225f req-e20fbf01-47e6-493e-b406-ee171d094f1c service nova] Creating event network-vif-plugged:b1b5ee45-e743-4819-bc49-534e21eec9a7 for instance 7af16d0b-59c7-43ea-856c-ec79029b680c on hv-cinder-81514 May 26 12:37:24.601413 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-a8876e2b-15bd-49a2-8b46-b2fe60ec225f req-e20fbf01-47e6-493e-b406-ee171d094f1c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036934 May 26 12:37:24.602228 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 308/602] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:37:24.739184 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-a84bbd2e-db0a-4dd3-9f7e-ed8a00d01dd2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:24.739792 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-a84bbd2e-db0a-4dd3-9f7e-ed8a00d01dd2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:24.746843 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a84bbd2e-db0a-4dd3-9f7e-ed8a00d01dd2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:24.747461 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a84bbd2e-db0a-4dd3-9f7e-ed8a00d01dd2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:24.747981 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a84bbd2e-db0a-4dd3-9f7e-ed8a00d01dd2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:24.748414 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a84bbd2e-db0a-4dd3-9f7e-ed8a00d01dd2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:24.879061 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a84bbd2e-db0a-4dd3-9f7e-ed8a00d01dd2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:24.886884 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-a84bbd2e-db0a-4dd3-9f7e-ed8a00d01dd2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f" status: 200 len: 1367 microversion: 2.1 time: 0.151523 May 26 12:37:24.888091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 295/603] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:24 2022] GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:37:25.038752 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-27973d06-1802-4f25-92f7-80fdd3693bd5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:25.039448 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-27973d06-1802-4f25-92f7-80fdd3693bd5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:25.046434 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-27973d06-1802-4f25-92f7-80fdd3693bd5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:25.046970 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-27973d06-1802-4f25-92f7-80fdd3693bd5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:25.047738 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-27973d06-1802-4f25-92f7-80fdd3693bd5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:25.048175 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-27973d06-1802-4f25-92f7-80fdd3693bd5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:25.178494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-27973d06-1802-4f25-92f7-80fdd3693bd5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:25.187353 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-27973d06-1802-4f25-92f7-80fdd3693bd5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:25.188920 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-27973d06-1802-4f25-92f7-80fdd3693bd5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:25.190094 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-27973d06-1802-4f25-92f7-80fdd3693bd5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1746 microversion: 2.20 time: 0.155610 May 26 12:37:25.190652 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 309/604] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:25 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:25.210602 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-576f40c9-0758-47b8-9831-8a170e62760b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:25.211204 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-576f40c9-0758-47b8-9831-8a170e62760b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:25.217516 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-576f40c9-0758-47b8-9831-8a170e62760b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:25.217963 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-576f40c9-0758-47b8-9831-8a170e62760b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:25.218713 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-576f40c9-0758-47b8-9831-8a170e62760b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:25.219148 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-576f40c9-0758-47b8-9831-8a170e62760b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:25.282208 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-576f40c9-0758-47b8-9831-8a170e62760b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:25.289639 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-576f40c9-0758-47b8-9831-8a170e62760b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1131 microversion: 2.1 time: 0.082814 May 26 12:37:25.290139 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 296/605] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:25 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1131 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:25.905268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-06b9aa8b-e44d-45b8-aa18-63ba006d493b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:25.905878 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-06b9aa8b-e44d-45b8-aa18-63ba006d493b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:25.911925 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-06b9aa8b-e44d-45b8-aa18-63ba006d493b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:25.912376 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-06b9aa8b-e44d-45b8-aa18-63ba006d493b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:25.913159 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-06b9aa8b-e44d-45b8-aa18-63ba006d493b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:25.913599 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-06b9aa8b-e44d-45b8-aa18-63ba006d493b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:26.208504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-9e5fb967-e523-4da9-a0e3-898274cc6575 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:26.209279 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-9e5fb967-e523-4da9-a0e3-898274cc6575 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:26.216361 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9e5fb967-e523-4da9-a0e3-898274cc6575 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:26.216922 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9e5fb967-e523-4da9-a0e3-898274cc6575 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:26.217761 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9e5fb967-e523-4da9-a0e3-898274cc6575 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:26.218201 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9e5fb967-e523-4da9-a0e3-898274cc6575 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:26.245805 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-06b9aa8b-e44d-45b8-aa18-63ba006d493b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:26.253480 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-06b9aa8b-e44d-45b8-aa18-63ba006d493b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f" status: 200 len: 1367 microversion: 2.1 time: 0.352879 May 26 12:37:26.254028 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 310/606] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:25 2022] GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f => generated 1367 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:26.307343 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ec4882f7-b5ec-4a59-bff5-1ec7beb1757f tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:26.308022 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ec4882f7-b5ec-4a59-bff5-1ec7beb1757f tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:26.314662 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ec4882f7-b5ec-4a59-bff5-1ec7beb1757f tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:26.315110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ec4882f7-b5ec-4a59-bff5-1ec7beb1757f tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:26.315973 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ec4882f7-b5ec-4a59-bff5-1ec7beb1757f tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:26.316409 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ec4882f7-b5ec-4a59-bff5-1ec7beb1757f tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:26.412108 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ec4882f7-b5ec-4a59-bff5-1ec7beb1757f tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:26.420991 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ec4882f7-b5ec-4a59-bff5-1ec7beb1757f tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1205 microversion: 2.1 time: 0.117485 May 26 12:37:26.421796 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 311/607] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:26 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1205 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:37:26.522497 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-9e5fb967-e523-4da9-a0e3-898274cc6575 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:26.532120 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-9e5fb967-e523-4da9-a0e3-898274cc6575 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:26.533687 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-9e5fb967-e523-4da9-a0e3-898274cc6575 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:26.534853 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-9e5fb967-e523-4da9-a0e3-898274cc6575 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1746 microversion: 2.20 time: 0.330292 May 26 12:37:26.536087 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 297/608] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:26 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1746 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:37:27.175837 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-89c16377-9d9f-4adc-ba82-b5f62ef07d90 req-96158c29-cef4-40b9-b0eb-b37b3c688055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "877c410c-52d3-4dcb-b248-61708093ac8f", "name": "network-vif-plugged", "status": "completed", "tag": "b7d790b4-17d2-4600-ae11-9a7bdeca8da6"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:27.192529 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-89c16377-9d9f-4adc-ba82-b5f62ef07d90 req-96158c29-cef4-40b9-b0eb-b37b3c688055 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:27.193361 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-89c16377-9d9f-4adc-ba82-b5f62ef07d90 req-96158c29-cef4-40b9-b0eb-b37b3c688055 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:27.206068 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-89c16377-9d9f-4adc-ba82-b5f62ef07d90 req-96158c29-cef4-40b9-b0eb-b37b3c688055 service nova] Creating event network-vif-plugged:b7d790b4-17d2-4600-ae11-9a7bdeca8da6 for instance 877c410c-52d3-4dcb-b248-61708093ac8f on hv-cinder-81514 May 26 12:37:27.210829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-89c16377-9d9f-4adc-ba82-b5f62ef07d90 req-96158c29-cef4-40b9-b0eb-b37b3c688055 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038989 May 26 12:37:27.211425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 312/609] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:37:27.270888 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-1daa63b4-8bd4-4c84-91a8-ba43bae9d5cf tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:27.271522 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-1daa63b4-8bd4-4c84-91a8-ba43bae9d5cf tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:27.279074 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1daa63b4-8bd4-4c84-91a8-ba43bae9d5cf tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:27.279843 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1daa63b4-8bd4-4c84-91a8-ba43bae9d5cf tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:27.280984 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1daa63b4-8bd4-4c84-91a8-ba43bae9d5cf tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:27.281670 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1daa63b4-8bd4-4c84-91a8-ba43bae9d5cf tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:27.439241 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-22435a26-64bf-4501-bbb7-c02c96df19b8 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:27.439957 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-22435a26-64bf-4501-bbb7-c02c96df19b8 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:27.446728 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-22435a26-64bf-4501-bbb7-c02c96df19b8 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:27.446907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-22435a26-64bf-4501-bbb7-c02c96df19b8 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:27.447550 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-22435a26-64bf-4501-bbb7-c02c96df19b8 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:27.448213 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-22435a26-64bf-4501-bbb7-c02c96df19b8 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:27.516010 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-1daa63b4-8bd4-4c84-91a8-ba43bae9d5cf tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:27.523408 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-1daa63b4-8bd4-4c84-91a8-ba43bae9d5cf tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f" status: 200 len: 1367 microversion: 2.1 time: 0.256353 May 26 12:37:27.523976 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 298/610] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:27 2022] GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:27.555314 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-94916804-378b-40fd-8866-9d9aac3b8e37 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:27.556496 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-94916804-378b-40fd-8866-9d9aac3b8e37 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:27.563922 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-94916804-378b-40fd-8866-9d9aac3b8e37 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:27.564380 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-94916804-378b-40fd-8866-9d9aac3b8e37 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:27.565191 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-94916804-378b-40fd-8866-9d9aac3b8e37 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:27.565885 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-94916804-378b-40fd-8866-9d9aac3b8e37 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:27.728347 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-22435a26-64bf-4501-bbb7-c02c96df19b8 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:27.736544 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-22435a26-64bf-4501-bbb7-c02c96df19b8 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1261 microversion: 2.1 time: 0.301459 May 26 12:37:27.737158 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 313/611] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:27 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1261 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:37:27.791225 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-94916804-378b-40fd-8866-9d9aac3b8e37 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:27.801910 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-94916804-378b-40fd-8866-9d9aac3b8e37 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:27.803595 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-94916804-378b-40fd-8866-9d9aac3b8e37 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:27.804935 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-94916804-378b-40fd-8866-9d9aac3b8e37 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1746 microversion: 2.20 time: 0.254419 May 26 12:37:27.805712 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 299/612] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:27 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1746 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:28.037340 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-6dac50d3-e46e-4b32-b8ed-8716eafd0fed req-c9a12a0f-63b6-4796-b953-793905f2d7a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a42e497c-0646-4450-9f42-f8da46762273", "tag": "e2c6e6e5-7173-4fde-a2ee-0c73b6a833ac"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:28.046823 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-6dac50d3-e46e-4b32-b8ed-8716eafd0fed req-c9a12a0f-63b6-4796-b953-793905f2d7a9 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:28.047271 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-6dac50d3-e46e-4b32-b8ed-8716eafd0fed req-c9a12a0f-63b6-4796-b953-793905f2d7a9 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:28.066784 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-6dac50d3-e46e-4b32-b8ed-8716eafd0fed req-c9a12a0f-63b6-4796-b953-793905f2d7a9 service nova] Creating event network-changed:e2c6e6e5-7173-4fde-a2ee-0c73b6a833ac for instance a42e497c-0646-4450-9f42-f8da46762273 on hv-cinder-81514 May 26 12:37:28.071515 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-6dac50d3-e46e-4b32-b8ed-8716eafd0fed req-c9a12a0f-63b6-4796-b953-793905f2d7a9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037968 May 26 12:37:28.072168 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 314/613] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:37:28.540500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-810e3282-f10d-45b1-a6ee-c2406cf535fa tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:28.541068 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-810e3282-f10d-45b1-a6ee-c2406cf535fa tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:28.548270 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-810e3282-f10d-45b1-a6ee-c2406cf535fa tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:28.548745 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-810e3282-f10d-45b1-a6ee-c2406cf535fa tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:28.549520 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-810e3282-f10d-45b1-a6ee-c2406cf535fa tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:28.549963 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-810e3282-f10d-45b1-a6ee-c2406cf535fa tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:28.681123 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-810e3282-f10d-45b1-a6ee-c2406cf535fa tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:28.688629 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-810e3282-f10d-45b1-a6ee-c2406cf535fa tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f" status: 200 len: 1367 microversion: 2.1 time: 0.152081 May 26 12:37:28.689229 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 300/614] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:28 2022] GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:28.753670 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-c82535ba-f60c-4403-a55f-ea0b7751d1dc tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:28.754361 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-c82535ba-f60c-4403-a55f-ea0b7751d1dc tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:28.760523 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c82535ba-f60c-4403-a55f-ea0b7751d1dc tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:28.761242 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c82535ba-f60c-4403-a55f-ea0b7751d1dc tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:28.762229 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c82535ba-f60c-4403-a55f-ea0b7751d1dc tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:28.762666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c82535ba-f60c-4403-a55f-ea0b7751d1dc tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:28.825171 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-937e80df-61cd-41b8-88fc-81153b5f6894 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:28.826093 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-937e80df-61cd-41b8-88fc-81153b5f6894 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:28.831955 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-937e80df-61cd-41b8-88fc-81153b5f6894 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:28.832384 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-937e80df-61cd-41b8-88fc-81153b5f6894 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:28.833174 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-937e80df-61cd-41b8-88fc-81153b5f6894 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:28.833611 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-937e80df-61cd-41b8-88fc-81153b5f6894 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:28.936623 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-c82535ba-f60c-4403-a55f-ea0b7751d1dc tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:28.944261 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-c82535ba-f60c-4403-a55f-ea0b7751d1dc tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1261 microversion: 2.1 time: 0.194820 May 26 12:37:28.944919 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 315/615] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:28 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1261 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:28.979979 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-937e80df-61cd-41b8-88fc-81153b5f6894 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:28.988328 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-937e80df-61cd-41b8-88fc-81153b5f6894 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:28.989864 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-937e80df-61cd-41b8-88fc-81153b5f6894 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:28.990995 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-937e80df-61cd-41b8-88fc-81153b5f6894 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1746 microversion: 2.20 time: 0.170350 May 26 12:37:28.991546 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 301/616] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:28 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1746 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:37:29.706456 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-97f4eb58-2a1b-4e04-9a1d-e21cd7457ce9 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:29.707060 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-97f4eb58-2a1b-4e04-9a1d-e21cd7457ce9 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:29.713027 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-97f4eb58-2a1b-4e04-9a1d-e21cd7457ce9 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:29.713469 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-97f4eb58-2a1b-4e04-9a1d-e21cd7457ce9 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:29.714218 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-97f4eb58-2a1b-4e04-9a1d-e21cd7457ce9 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:29.714650 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-97f4eb58-2a1b-4e04-9a1d-e21cd7457ce9 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:29.961701 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-44ac89f9-f79b-4cb3-bfe4-e6619e424225 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:29.962315 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-44ac89f9-f79b-4cb3-bfe4-e6619e424225 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:29.969318 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-44ac89f9-f79b-4cb3-bfe4-e6619e424225 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:29.969770 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-44ac89f9-f79b-4cb3-bfe4-e6619e424225 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:29.970553 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-44ac89f9-f79b-4cb3-bfe4-e6619e424225 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:29.971001 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-44ac89f9-f79b-4cb3-bfe4-e6619e424225 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:29.990408 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=100 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:30.138724 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-97f4eb58-2a1b-4e04-9a1d-e21cd7457ce9 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:30.146104 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-97f4eb58-2a1b-4e04-9a1d-e21cd7457ce9 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f" status: 200 len: 1367 microversion: 2.1 time: 0.443472 May 26 12:37:30.146661 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 316/617] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:29 2022] GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f => generated 1367 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:30.155398 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-385d0a82-3851-47c9-97b7-1b5edac9c1a7 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:30.156006 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-385d0a82-3851-47c9-97b7-1b5edac9c1a7 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:30.163717 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-385d0a82-3851-47c9-97b7-1b5edac9c1a7 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:30.164172 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-385d0a82-3851-47c9-97b7-1b5edac9c1a7 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:30.164969 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-385d0a82-3851-47c9-97b7-1b5edac9c1a7 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:30.165410 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-385d0a82-3851-47c9-97b7-1b5edac9c1a7 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:30.253614 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-44ac89f9-f79b-4cb3-bfe4-e6619e424225 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:30.262641 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-44ac89f9-f79b-4cb3-bfe4-e6619e424225 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1261 microversion: 2.1 time: 0.304766 May 26 12:37:30.264863 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 302/618] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:29 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1261 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:37:30.351455 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-385d0a82-3851-47c9-97b7-1b5edac9c1a7 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:30.359736 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-385d0a82-3851-47c9-97b7-1b5edac9c1a7 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:30.361405 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-385d0a82-3851-47c9-97b7-1b5edac9c1a7 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:30.362438 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-385d0a82-3851-47c9-97b7-1b5edac9c1a7 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1746 microversion: 2.20 time: 0.211414 May 26 12:37:30.362999 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 317/619] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:30 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1746 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:31.163499 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-7d35aa96-65f8-485c-b29d-16efc3be5c88 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:31.164008 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-7d35aa96-65f8-485c-b29d-16efc3be5c88 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:31.171224 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7d35aa96-65f8-485c-b29d-16efc3be5c88 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:31.171680 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7d35aa96-65f8-485c-b29d-16efc3be5c88 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:31.172444 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7d35aa96-65f8-485c-b29d-16efc3be5c88 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:31.172919 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7d35aa96-65f8-485c-b29d-16efc3be5c88 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:31.281238 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e307690c-6eb6-497e-8baa-b9be3ce032c4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:31.282052 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e307690c-6eb6-497e-8baa-b9be3ce032c4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:31.288027 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e307690c-6eb6-497e-8baa-b9be3ce032c4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:31.288703 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e307690c-6eb6-497e-8baa-b9be3ce032c4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:31.289486 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e307690c-6eb6-497e-8baa-b9be3ce032c4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:31.289926 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e307690c-6eb6-497e-8baa-b9be3ce032c4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:31.303937 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-7d35aa96-65f8-485c-b29d-16efc3be5c88 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:31.312141 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-7d35aa96-65f8-485c-b29d-16efc3be5c88 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f" status: 200 len: 1558 microversion: 2.1 time: 0.152640 May 26 12:37:31.312729 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 303/620] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:31 2022] GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:31.328448 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-487e1ef9-37ab-42d3-81ff-200f32523704 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:31.328986 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-487e1ef9-37ab-42d3-81ff-200f32523704 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:31.335089 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-487e1ef9-37ab-42d3-81ff-200f32523704 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:31.335544 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-487e1ef9-37ab-42d3-81ff-200f32523704 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:31.336312 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-487e1ef9-37ab-42d3-81ff-200f32523704 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:31.336776 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-487e1ef9-37ab-42d3-81ff-200f32523704 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:31.436278 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-487e1ef9-37ab-42d3-81ff-200f32523704 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111769 May 26 12:37:31.436894 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 304/621] 10.222.0.39 () {58 vars in 1274 bytes} [Thu May 26 12:37:31 2022] GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:37:31.446826 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-9660fbe7-8b88-4197-a6c3-4f6bad28326d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:31.447439 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-9660fbe7-8b88-4197-a6c3-4f6bad28326d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:31.454207 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9660fbe7-8b88-4197-a6c3-4f6bad28326d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:31.454658 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9660fbe7-8b88-4197-a6c3-4f6bad28326d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:31.455431 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9660fbe7-8b88-4197-a6c3-4f6bad28326d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:31.455869 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9660fbe7-8b88-4197-a6c3-4f6bad28326d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:31.466329 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e307690c-6eb6-497e-8baa-b9be3ce032c4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:31.475197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e307690c-6eb6-497e-8baa-b9be3ce032c4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1261 microversion: 2.1 time: 0.197771 May 26 12:37:31.476972 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 318/622] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:31 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1261 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:37:31.599231 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-9660fbe7-8b88-4197-a6c3-4f6bad28326d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:31.608306 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-9660fbe7-8b88-4197-a6c3-4f6bad28326d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:31.609866 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-9660fbe7-8b88-4197-a6c3-4f6bad28326d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:31.611050 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-9660fbe7-8b88-4197-a6c3-4f6bad28326d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1746 microversion: 2.20 time: 0.173200 May 26 12:37:31.611611 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 305/623] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:31 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1746 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:32.369882 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-658d3160-675f-429c-8657-f135ee4354c9 req-759f5eba-e3b1-4823-9b8b-c73321117a82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "877c410c-52d3-4dcb-b248-61708093ac8f", "tag": "b7d790b4-17d2-4600-ae11-9a7bdeca8da6"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:32.373661 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=4 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:32.374325 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=18 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:32.380746 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-658d3160-675f-429c-8657-f135ee4354c9 req-759f5eba-e3b1-4823-9b8b-c73321117a82 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:32.381216 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-658d3160-675f-429c-8657-f135ee4354c9 req-759f5eba-e3b1-4823-9b8b-c73321117a82 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:32.392761 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-658d3160-675f-429c-8657-f135ee4354c9 req-759f5eba-e3b1-4823-9b8b-c73321117a82 service nova] Creating event network-changed:b7d790b4-17d2-4600-ae11-9a7bdeca8da6 for instance 877c410c-52d3-4dcb-b248-61708093ac8f on hv-cinder-81514 May 26 12:37:32.397822 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-658d3160-675f-429c-8657-f135ee4354c9 req-759f5eba-e3b1-4823-9b8b-c73321117a82 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031561 May 26 12:37:32.398590 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 319/624] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:37:32.491394 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-5d501c0b-041e-4289-9a87-c2e4b12e69ff tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:32.491988 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-5d501c0b-041e-4289-9a87-c2e4b12e69ff tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:32.493916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell0:SELECT=2 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:32.499955 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5d501c0b-041e-4289-9a87-c2e4b12e69ff tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:32.500499 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5d501c0b-041e-4289-9a87-c2e4b12e69ff tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:32.501289 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5d501c0b-041e-4289-9a87-c2e4b12e69ff tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:32.501726 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5d501c0b-041e-4289-9a87-c2e4b12e69ff tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:32.630301 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d1ac94b5-2b05-46e2-8abb-1013f60f459b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:32.630469 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-5d501c0b-041e-4289-9a87-c2e4b12e69ff tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:32.631267 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d1ac94b5-2b05-46e2-8abb-1013f60f459b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:32.638362 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d1ac94b5-2b05-46e2-8abb-1013f60f459b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:32.638809 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d1ac94b5-2b05-46e2-8abb-1013f60f459b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:32.639381 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-5d501c0b-041e-4289-9a87-c2e4b12e69ff tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1261 microversion: 2.1 time: 0.151820 May 26 12:37:32.639572 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d1ac94b5-2b05-46e2-8abb-1013f60f459b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:32.640005 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d1ac94b5-2b05-46e2-8abb-1013f60f459b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:32.640351 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 306/625] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:32 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:32.781747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d1ac94b5-2b05-46e2-8abb-1013f60f459b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:32.796841 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d1ac94b5-2b05-46e2-8abb-1013f60f459b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:32.799803 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d1ac94b5-2b05-46e2-8abb-1013f60f459b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:32.802004 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-d1ac94b5-2b05-46e2-8abb-1013f60f459b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1746 microversion: 2.20 time: 0.176123 May 26 12:37:32.803012 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 320/626] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:32 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1746 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:37:33.657477 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-c9498e99-9370-428e-abbe-6e0c460234f7 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:33.658396 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-c9498e99-9370-428e-abbe-6e0c460234f7 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:33.666752 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c9498e99-9370-428e-abbe-6e0c460234f7 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:33.666863 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c9498e99-9370-428e-abbe-6e0c460234f7 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:33.667579 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c9498e99-9370-428e-abbe-6e0c460234f7 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:33.668548 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c9498e99-9370-428e-abbe-6e0c460234f7 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:33.826094 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c9498e99-9370-428e-abbe-6e0c460234f7 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:33.829426 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-7de28b2c-9911-47d1-bdb2-fabf65cd267d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:33.830722 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-7de28b2c-9911-47d1-bdb2-fabf65cd267d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:33.837492 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7de28b2c-9911-47d1-bdb2-fabf65cd267d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:33.837685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-c9498e99-9370-428e-abbe-6e0c460234f7 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1261 microversion: 2.1 time: 0.184628 May 26 12:37:33.837949 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7de28b2c-9911-47d1-bdb2-fabf65cd267d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:33.838914 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7de28b2c-9911-47d1-bdb2-fabf65cd267d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:33.839376 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7de28b2c-9911-47d1-bdb2-fabf65cd267d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:33.841707 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 307/627] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:33 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1261 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:33.990536 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-7de28b2c-9911-47d1-bdb2-fabf65cd267d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:34.000280 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-7de28b2c-9911-47d1-bdb2-fabf65cd267d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:34.002072 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-7de28b2c-9911-47d1-bdb2-fabf65cd267d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:34.003223 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-7de28b2c-9911-47d1-bdb2-fabf65cd267d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1741 microversion: 2.20 time: 0.177930 May 26 12:37:34.004113 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 321/628] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:33 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:37:34.858913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b2d483e2-45ad-4c82-af86-4b6a1e807f8e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:34.860174 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b2d483e2-45ad-4c82-af86-4b6a1e807f8e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:34.866985 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b2d483e2-45ad-4c82-af86-4b6a1e807f8e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:34.867499 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b2d483e2-45ad-4c82-af86-4b6a1e807f8e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:34.868660 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b2d483e2-45ad-4c82-af86-4b6a1e807f8e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:34.869126 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b2d483e2-45ad-4c82-af86-4b6a1e807f8e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:35.020485 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b2d483e2-45ad-4c82-af86-4b6a1e807f8e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:35.023747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-2f234c71-38b9-4c24-b410-2f21f2762717 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:35.025082 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-2f234c71-38b9-4c24-b410-2f21f2762717 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:35.030122 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b2d483e2-45ad-4c82-af86-4b6a1e807f8e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1261 microversion: 2.1 time: 0.175949 May 26 12:37:35.030705 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 308/629] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:34 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1261 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:35.033351 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2f234c71-38b9-4c24-b410-2f21f2762717 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:35.034068 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2f234c71-38b9-4c24-b410-2f21f2762717 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:35.035074 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2f234c71-38b9-4c24-b410-2f21f2762717 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:35.035726 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2f234c71-38b9-4c24-b410-2f21f2762717 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:35.173129 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-2f234c71-38b9-4c24-b410-2f21f2762717 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:35.180988 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-2f234c71-38b9-4c24-b410-2f21f2762717 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:35.182496 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-2f234c71-38b9-4c24-b410-2f21f2762717 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:35.184189 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-2f234c71-38b9-4c24-b410-2f21f2762717 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1741 microversion: 2.20 time: 0.164964 May 26 12:37:35.184801 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 322/630] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:35 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:36.047998 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-3b867103-c063-44ec-9896-659a1a73e402 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:36.048608 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-3b867103-c063-44ec-9896-659a1a73e402 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:36.055226 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3b867103-c063-44ec-9896-659a1a73e402 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:36.055681 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3b867103-c063-44ec-9896-659a1a73e402 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:36.056452 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3b867103-c063-44ec-9896-659a1a73e402 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:36.056927 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3b867103-c063-44ec-9896-659a1a73e402 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:36.209015 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-fe658e27-ea74-471c-a307-b8dd3ba481e3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:36.210028 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-fe658e27-ea74-471c-a307-b8dd3ba481e3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:36.220545 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-3b867103-c063-44ec-9896-659a1a73e402 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:36.229987 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-3b867103-c063-44ec-9896-659a1a73e402 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1261 microversion: 2.1 time: 0.185831 May 26 12:37:36.230226 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fe658e27-ea74-471c-a307-b8dd3ba481e3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:36.231344 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fe658e27-ea74-471c-a307-b8dd3ba481e3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:36.233651 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fe658e27-ea74-471c-a307-b8dd3ba481e3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:36.234773 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fe658e27-ea74-471c-a307-b8dd3ba481e3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:36.241541 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 309/631] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:36 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1261 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:36.415709 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-fe658e27-ea74-471c-a307-b8dd3ba481e3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:36.423683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-fe658e27-ea74-471c-a307-b8dd3ba481e3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:36.425284 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-fe658e27-ea74-471c-a307-b8dd3ba481e3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:36.426472 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-fe658e27-ea74-471c-a307-b8dd3ba481e3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1741 microversion: 2.20 time: 0.224077 May 26 12:37:36.436911 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 323/632] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:36 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1741 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:37.262598 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-30f0c06a-31d8-48cd-acf7-53225b357c6f tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:37.264756 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-30f0c06a-31d8-48cd-acf7-53225b357c6f tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:37.276529 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-30f0c06a-31d8-48cd-acf7-53225b357c6f tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:37.278203 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-30f0c06a-31d8-48cd-acf7-53225b357c6f tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:37.279260 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-30f0c06a-31d8-48cd-acf7-53225b357c6f tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:37.279791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-30f0c06a-31d8-48cd-acf7-53225b357c6f tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:37.441466 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-30f0c06a-31d8-48cd-acf7-53225b357c6f tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:37.445780 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-0f214c2d-1479-4a1e-84d4-f637e90b6deb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:37.446397 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-0f214c2d-1479-4a1e-84d4-f637e90b6deb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:37.452866 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-30f0c06a-31d8-48cd-acf7-53225b357c6f tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1261 microversion: 2.1 time: 0.199368 May 26 12:37:37.453965 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0f214c2d-1479-4a1e-84d4-f637e90b6deb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:37.454413 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0f214c2d-1479-4a1e-84d4-f637e90b6deb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:37.455292 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 310/633] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:37 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1261 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:37.455498 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0f214c2d-1479-4a1e-84d4-f637e90b6deb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:37.455952 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0f214c2d-1479-4a1e-84d4-f637e90b6deb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:37.461962 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=100 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:37.602980 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-0f214c2d-1479-4a1e-84d4-f637e90b6deb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:37.611336 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-0f214c2d-1479-4a1e-84d4-f637e90b6deb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:37.612941 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-0f214c2d-1479-4a1e-84d4-f637e90b6deb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:37.614105 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-0f214c2d-1479-4a1e-84d4-f637e90b6deb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1741 microversion: 2.20 time: 0.173050 May 26 12:37:37.614668 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 324/634] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:37 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:38.471249 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-c242126f-9ad9-4d9b-98d2-895ae9b813e4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:38.472870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-c242126f-9ad9-4d9b-98d2-895ae9b813e4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:38.479723 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c242126f-9ad9-4d9b-98d2-895ae9b813e4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:38.480174 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c242126f-9ad9-4d9b-98d2-895ae9b813e4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:38.481017 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c242126f-9ad9-4d9b-98d2-895ae9b813e4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:38.481459 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c242126f-9ad9-4d9b-98d2-895ae9b813e4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:38.625790 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c242126f-9ad9-4d9b-98d2-895ae9b813e4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:38.633633 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-3a0fd054-3a25-433c-83ae-137c934ac1f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:38.634236 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-3a0fd054-3a25-433c-83ae-137c934ac1f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:38.634396 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-c242126f-9ad9-4d9b-98d2-895ae9b813e4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1261 microversion: 2.1 time: 0.166768 May 26 12:37:38.637515 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 311/635] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:38 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:38.641901 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3a0fd054-3a25-433c-83ae-137c934ac1f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:38.642452 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3a0fd054-3a25-433c-83ae-137c934ac1f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:38.643351 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3a0fd054-3a25-433c-83ae-137c934ac1f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:38.644214 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3a0fd054-3a25-433c-83ae-137c934ac1f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:38.807223 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-3a0fd054-3a25-433c-83ae-137c934ac1f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:38.816439 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-3a0fd054-3a25-433c-83ae-137c934ac1f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:38.817980 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-3a0fd054-3a25-433c-83ae-137c934ac1f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:38.819375 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-3a0fd054-3a25-433c-83ae-137c934ac1f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1741 microversion: 2.20 time: 0.189714 May 26 12:37:38.820748 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 325/636] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:38 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1741 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:37:39.657076 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-0ed3bb73-aa8e-49b3-b55c-0d9b7aa52b63 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:39.658522 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-0ed3bb73-aa8e-49b3-b55c-0d9b7aa52b63 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:39.665632 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0ed3bb73-aa8e-49b3-b55c-0d9b7aa52b63 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:39.666084 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0ed3bb73-aa8e-49b3-b55c-0d9b7aa52b63 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:39.667125 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0ed3bb73-aa8e-49b3-b55c-0d9b7aa52b63 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:39.667598 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0ed3bb73-aa8e-49b3-b55c-0d9b7aa52b63 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:39.825470 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-0ed3bb73-aa8e-49b3-b55c-0d9b7aa52b63 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:39.834051 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-0ed3bb73-aa8e-49b3-b55c-0d9b7aa52b63 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1261 microversion: 2.1 time: 0.182527 May 26 12:37:39.838339 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-a9076e8e-227c-4665-9784-0b6b409fce07 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:39.839873 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-a9076e8e-227c-4665-9784-0b6b409fce07 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:39.840817 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 312/637] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:39 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1261 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:39.847472 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a9076e8e-227c-4665-9784-0b6b409fce07 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:39.848004 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a9076e8e-227c-4665-9784-0b6b409fce07 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:39.848801 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a9076e8e-227c-4665-9784-0b6b409fce07 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:39.849237 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a9076e8e-227c-4665-9784-0b6b409fce07 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:39.999319 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-a9076e8e-227c-4665-9784-0b6b409fce07 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:40.008066 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-a9076e8e-227c-4665-9784-0b6b409fce07 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:40.009615 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-a9076e8e-227c-4665-9784-0b6b409fce07 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:40.010772 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-a9076e8e-227c-4665-9784-0b6b409fce07 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1741 microversion: 2.20 time: 0.177117 May 26 12:37:40.011589 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 326/638] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:39 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1741 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:37:40.852776 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-d4301086-b9b2-4fcf-a083-0e1f9ff3965d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:40.853479 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-d4301086-b9b2-4fcf-a083-0e1f9ff3965d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:40.862723 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d4301086-b9b2-4fcf-a083-0e1f9ff3965d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:40.863405 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d4301086-b9b2-4fcf-a083-0e1f9ff3965d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:40.864361 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d4301086-b9b2-4fcf-a083-0e1f9ff3965d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:40.864830 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d4301086-b9b2-4fcf-a083-0e1f9ff3965d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:41.019706 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d4301086-b9b2-4fcf-a083-0e1f9ff3965d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:41.030625 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-0fe01c35-17ba-490f-ab1a-0fc8477ff8a4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:41.031258 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-0fe01c35-17ba-490f-ab1a-0fc8477ff8a4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:41.035245 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-d4301086-b9b2-4fcf-a083-0e1f9ff3965d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1261 microversion: 2.1 time: 0.187957 May 26 12:37:41.048495 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 313/639] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:40 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1261 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:41.050217 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0fe01c35-17ba-490f-ab1a-0fc8477ff8a4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:41.050679 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0fe01c35-17ba-490f-ab1a-0fc8477ff8a4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:41.051477 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0fe01c35-17ba-490f-ab1a-0fc8477ff8a4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:41.052113 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0fe01c35-17ba-490f-ab1a-0fc8477ff8a4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:41.215049 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-0fe01c35-17ba-490f-ab1a-0fc8477ff8a4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:41.225843 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-0fe01c35-17ba-490f-ab1a-0fc8477ff8a4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:41.227754 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-0fe01c35-17ba-490f-ab1a-0fc8477ff8a4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:41.229268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-0fe01c35-17ba-490f-ab1a-0fc8477ff8a4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1741 microversion: 2.20 time: 0.203546 May 26 12:37:41.230066 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 327/640] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:41 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1741 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:37:42.051519 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-85a79b7f-87a6-49a5-b312-632943e0781d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:42.053286 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-85a79b7f-87a6-49a5-b312-632943e0781d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:42.060851 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-85a79b7f-87a6-49a5-b312-632943e0781d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:42.061859 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-85a79b7f-87a6-49a5-b312-632943e0781d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:42.063472 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-85a79b7f-87a6-49a5-b312-632943e0781d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:42.064541 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-85a79b7f-87a6-49a5-b312-632943e0781d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:42.250466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-c1876783-c04f-428a-b89e-64def75ebf06 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:42.251550 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-c1876783-c04f-428a-b89e-64def75ebf06 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:42.271269 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-85a79b7f-87a6-49a5-b312-632943e0781d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:42.281112 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-85a79b7f-87a6-49a5-b312-632943e0781d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1261 microversion: 2.1 time: 0.233305 May 26 12:37:42.282336 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c1876783-c04f-428a-b89e-64def75ebf06 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:42.283094 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 314/641] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:42 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1261 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:42.293567 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c1876783-c04f-428a-b89e-64def75ebf06 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:42.294934 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c1876783-c04f-428a-b89e-64def75ebf06 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:42.295745 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c1876783-c04f-428a-b89e-64def75ebf06 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:42.482998 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-c1876783-c04f-428a-b89e-64def75ebf06 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:42.492393 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-c1876783-c04f-428a-b89e-64def75ebf06 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:42.494682 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-c1876783-c04f-428a-b89e-64def75ebf06 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:42.496127 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-c1876783-c04f-428a-b89e-64def75ebf06 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1741 microversion: 2.20 time: 0.252212 May 26 12:37:42.507173 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 328/642] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:42 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1741 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:43.301096 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-90c1255d-bc54-4b06-ac3c-15584a13ebfe tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:43.301801 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-90c1255d-bc54-4b06-ac3c-15584a13ebfe tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:43.321471 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-90c1255d-bc54-4b06-ac3c-15584a13ebfe tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:43.321924 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-90c1255d-bc54-4b06-ac3c-15584a13ebfe tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:43.322755 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-90c1255d-bc54-4b06-ac3c-15584a13ebfe tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:43.323191 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-90c1255d-bc54-4b06-ac3c-15584a13ebfe tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:43.472435 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-90c1255d-bc54-4b06-ac3c-15584a13ebfe tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:43.480805 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-90c1255d-bc54-4b06-ac3c-15584a13ebfe tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1261 microversion: 2.1 time: 0.183527 May 26 12:37:43.485353 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 315/643] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:43 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1261 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:43.515473 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-fea039c9-b4c5-42b8-8f04-d042c4de02ab tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:43.516099 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-fea039c9-b4c5-42b8-8f04-d042c4de02ab tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:43.522469 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fea039c9-b4c5-42b8-8f04-d042c4de02ab tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:43.523152 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fea039c9-b4c5-42b8-8f04-d042c4de02ab tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:43.523938 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fea039c9-b4c5-42b8-8f04-d042c4de02ab tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:43.524385 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fea039c9-b4c5-42b8-8f04-d042c4de02ab tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:43.669893 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-fea039c9-b4c5-42b8-8f04-d042c4de02ab tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:43.681449 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-fea039c9-b4c5-42b8-8f04-d042c4de02ab tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:43.683190 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-fea039c9-b4c5-42b8-8f04-d042c4de02ab tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:43.684439 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-fea039c9-b4c5-42b8-8f04-d042c4de02ab tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1741 microversion: 2.20 time: 0.173455 May 26 12:37:43.685834 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 329/644] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:43 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:44.151892 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-2846f16f-0e40-4e7a-a0e6-c37c3f9cf6ba req-5f249a36-5f30-45c8-b9cd-4f15a67111a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a42e497c-0646-4450-9f42-f8da46762273", "name": "network-vif-plugged", "status": "completed", "tag": "e2c6e6e5-7173-4fde-a2ee-0c73b6a833ac"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:44.171810 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-2846f16f-0e40-4e7a-a0e6-c37c3f9cf6ba req-5f249a36-5f30-45c8-b9cd-4f15a67111a2 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:44.171810 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-2846f16f-0e40-4e7a-a0e6-c37c3f9cf6ba req-5f249a36-5f30-45c8-b9cd-4f15a67111a2 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:44.185327 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-2846f16f-0e40-4e7a-a0e6-c37c3f9cf6ba req-5f249a36-5f30-45c8-b9cd-4f15a67111a2 service nova] Creating event network-vif-plugged:e2c6e6e5-7173-4fde-a2ee-0c73b6a833ac for instance a42e497c-0646-4450-9f42-f8da46762273 on hv-cinder-81514 May 26 12:37:44.195647 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-2846f16f-0e40-4e7a-a0e6-c37c3f9cf6ba req-5f249a36-5f30-45c8-b9cd-4f15a67111a2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047437 May 26 12:37:44.196619 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 316/645] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:37:44.501448 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-8dc9eaa6-72e4-4942-9c07-75de0fc6e490 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:44.502485 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-8dc9eaa6-72e4-4942-9c07-75de0fc6e490 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:44.509555 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8dc9eaa6-72e4-4942-9c07-75de0fc6e490 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:44.510308 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8dc9eaa6-72e4-4942-9c07-75de0fc6e490 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:44.511561 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8dc9eaa6-72e4-4942-9c07-75de0fc6e490 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:44.512213 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8dc9eaa6-72e4-4942-9c07-75de0fc6e490 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:44.710476 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-79459d58-3ffc-4713-af3a-a16389040a23 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:44.711943 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-79459d58-3ffc-4713-af3a-a16389040a23 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:44.715707 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-8dc9eaa6-72e4-4942-9c07-75de0fc6e490 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:44.719712 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-79459d58-3ffc-4713-af3a-a16389040a23 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:44.720469 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-79459d58-3ffc-4713-af3a-a16389040a23 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:44.721429 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-79459d58-3ffc-4713-af3a-a16389040a23 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:44.722077 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-79459d58-3ffc-4713-af3a-a16389040a23 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:44.728562 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-8dc9eaa6-72e4-4942-9c07-75de0fc6e490 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1261 microversion: 2.1 time: 0.232303 May 26 12:37:44.741421 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 330/646] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:44 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1261 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:44.891549 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-79459d58-3ffc-4713-af3a-a16389040a23 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:44.900072 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-79459d58-3ffc-4713-af3a-a16389040a23 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:44.901613 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-79459d58-3ffc-4713-af3a-a16389040a23 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:44.902751 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-79459d58-3ffc-4713-af3a-a16389040a23 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1741 microversion: 2.20 time: 0.197239 May 26 12:37:44.908554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 317/647] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:44 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1741 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:45.749480 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-7b5c16f0-385e-44ca-bf7c-3a29d9e4f185 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:45.750091 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-7b5c16f0-385e-44ca-bf7c-3a29d9e4f185 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:45.756066 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7b5c16f0-385e-44ca-bf7c-3a29d9e4f185 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:45.756519 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7b5c16f0-385e-44ca-bf7c-3a29d9e4f185 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:45.757310 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7b5c16f0-385e-44ca-bf7c-3a29d9e4f185 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:45.757752 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7b5c16f0-385e-44ca-bf7c-3a29d9e4f185 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:45.892155 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-7b5c16f0-385e-44ca-bf7c-3a29d9e4f185 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:45.899871 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-7b5c16f0-385e-44ca-bf7c-3a29d9e4f185 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1261 microversion: 2.1 time: 0.154772 May 26 12:37:45.900427 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 331/648] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:45 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:46.023460 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-4c8c8fbb-09fd-4e8b-8be4-f43a589b84b9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:46.024067 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-4c8c8fbb-09fd-4e8b-8be4-f43a589b84b9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:46.030042 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4c8c8fbb-09fd-4e8b-8be4-f43a589b84b9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:46.030493 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4c8c8fbb-09fd-4e8b-8be4-f43a589b84b9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:46.031254 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4c8c8fbb-09fd-4e8b-8be4-f43a589b84b9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:46.031692 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4c8c8fbb-09fd-4e8b-8be4-f43a589b84b9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:46.166030 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-4c8c8fbb-09fd-4e8b-8be4-f43a589b84b9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:46.174620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-4c8c8fbb-09fd-4e8b-8be4-f43a589b84b9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:46.176116 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-4c8c8fbb-09fd-4e8b-8be4-f43a589b84b9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:46.177295 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-4c8c8fbb-09fd-4e8b-8be4-f43a589b84b9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1741 microversion: 2.20 time: 0.260493 May 26 12:37:46.177848 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 318/649] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:45 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1741 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:46.916843 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-174867ab-c228-4c71-9bb8-60051e8bdeb7 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:46.917713 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-174867ab-c228-4c71-9bb8-60051e8bdeb7 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:46.924516 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-174867ab-c228-4c71-9bb8-60051e8bdeb7 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:46.924992 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-174867ab-c228-4c71-9bb8-60051e8bdeb7 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:46.925765 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-174867ab-c228-4c71-9bb8-60051e8bdeb7 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:46.926204 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-174867ab-c228-4c71-9bb8-60051e8bdeb7 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:47.058925 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-174867ab-c228-4c71-9bb8-60051e8bdeb7 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:47.067184 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-174867ab-c228-4c71-9bb8-60051e8bdeb7 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1261 microversion: 2.1 time: 0.154239 May 26 12:37:47.067740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 332/650] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:46 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:47.196632 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-9cd693ca-d5ac-4c19-acc5-b88986403620 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:47.197203 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-9cd693ca-d5ac-4c19-acc5-b88986403620 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:47.204073 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9cd693ca-d5ac-4c19-acc5-b88986403620 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:47.204525 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9cd693ca-d5ac-4c19-acc5-b88986403620 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:47.205324 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9cd693ca-d5ac-4c19-acc5-b88986403620 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:47.205765 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9cd693ca-d5ac-4c19-acc5-b88986403620 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:47.343193 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-9cd693ca-d5ac-4c19-acc5-b88986403620 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:47.351451 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-9cd693ca-d5ac-4c19-acc5-b88986403620 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:47.352991 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-9cd693ca-d5ac-4c19-acc5-b88986403620 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:47.354151 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-9cd693ca-d5ac-4c19-acc5-b88986403620 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1741 microversion: 2.20 time: 0.161562 May 26 12:37:47.354704 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 319/651] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:47 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1741 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:48.083926 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-b3a01a0a-1ef6-414d-ada0-82d28f126a1d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:48.084585 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-b3a01a0a-1ef6-414d-ada0-82d28f126a1d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:48.090675 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b3a01a0a-1ef6-414d-ada0-82d28f126a1d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:48.091120 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b3a01a0a-1ef6-414d-ada0-82d28f126a1d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:48.092284 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b3a01a0a-1ef6-414d-ada0-82d28f126a1d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:48.092751 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b3a01a0a-1ef6-414d-ada0-82d28f126a1d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:48.228881 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-b3a01a0a-1ef6-414d-ada0-82d28f126a1d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:48.236525 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-b3a01a0a-1ef6-414d-ada0-82d28f126a1d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1445 microversion: 2.1 time: 0.156410 May 26 12:37:48.237139 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 333/652] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:48 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1445 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:37:48.253538 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-4822416b-f527-43dd-8a56-dbf458555cca tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:48.254165 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-4822416b-f527-43dd-8a56-dbf458555cca tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:48.260650 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4822416b-f527-43dd-8a56-dbf458555cca tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:48.261375 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4822416b-f527-43dd-8a56-dbf458555cca tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:48.262170 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4822416b-f527-43dd-8a56-dbf458555cca tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:48.262607 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4822416b-f527-43dd-8a56-dbf458555cca tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:48.267283 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=100 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:48.374185 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-169866bd-f0d9-4bdf-bcfd-4bc2ca343417 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:48.374823 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-169866bd-f0d9-4bdf-bcfd-4bc2ca343417 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:48.381072 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-169866bd-f0d9-4bdf-bcfd-4bc2ca343417 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:48.381559 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-169866bd-f0d9-4bdf-bcfd-4bc2ca343417 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:48.382361 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-169866bd-f0d9-4bdf-bcfd-4bc2ca343417 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:48.382818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-169866bd-f0d9-4bdf-bcfd-4bc2ca343417 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:48.401500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-4822416b-f527-43dd-8a56-dbf458555cca tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:48.409249 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-4822416b-f527-43dd-8a56-dbf458555cca tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1445 microversion: 2.1 time: 0.159665 May 26 12:37:48.409815 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 320/653] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:37:48 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1445 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:48.522640 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-169866bd-f0d9-4bdf-bcfd-4bc2ca343417 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:48.531079 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-169866bd-f0d9-4bdf-bcfd-4bc2ca343417 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:48.532593 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-169866bd-f0d9-4bdf-bcfd-4bc2ca343417 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:48.533800 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-169866bd-f0d9-4bdf-bcfd-4bc2ca343417 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1723 microversion: 2.20 time: 0.164701 May 26 12:37:48.534408 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 334/654] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:48 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:37:49.554041 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-1d043627-c273-46d8-bd7d-a18f99d31cf4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:49.554687 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-1d043627-c273-46d8-bd7d-a18f99d31cf4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:49.561751 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1d043627-c273-46d8-bd7d-a18f99d31cf4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:49.562199 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1d043627-c273-46d8-bd7d-a18f99d31cf4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:49.562969 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1d043627-c273-46d8-bd7d-a18f99d31cf4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:49.563405 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1d043627-c273-46d8-bd7d-a18f99d31cf4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:49.697963 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-1d043627-c273-46d8-bd7d-a18f99d31cf4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:49.706982 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-1d043627-c273-46d8-bd7d-a18f99d31cf4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:49.708497 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-1d043627-c273-46d8-bd7d-a18f99d31cf4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:49.709679 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-1d043627-c273-46d8-bd7d-a18f99d31cf4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1723 microversion: 2.20 time: 0.159645 May 26 12:37:49.710239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 321/655] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:49 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:50.117213 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-2413e1b9-d4ab-4cea-9712-137824c7c674 req-ef88896c-89e7-4a3b-84be-d1bcfc15a0d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7af16d0b-59c7-43ea-856c-ec79029b680c", "name": "network-vif-unplugged", "status": "completed", "tag": "b1b5ee45-e743-4819-bc49-534e21eec9a7"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:50.126512 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-2413e1b9-d4ab-4cea-9712-137824c7c674 req-ef88896c-89e7-4a3b-84be-d1bcfc15a0d6 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:50.127064 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-2413e1b9-d4ab-4cea-9712-137824c7c674 req-ef88896c-89e7-4a3b-84be-d1bcfc15a0d6 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:50.138683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-2413e1b9-d4ab-4cea-9712-137824c7c674 req-ef88896c-89e7-4a3b-84be-d1bcfc15a0d6 service nova] Creating event network-vif-unplugged:b1b5ee45-e743-4819-bc49-534e21eec9a7 for instance 7af16d0b-59c7-43ea-856c-ec79029b680c on hv-cinder-81514 May 26 12:37:50.144266 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-2413e1b9-d4ab-4cea-9712-137824c7c674 req-ef88896c-89e7-4a3b-84be-d1bcfc15a0d6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031357 May 26 12:37:50.145239 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 335/656] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:37:50.378947 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-46ffcf4d-cf56-4fac-8b08-bcdc033938ba req-fee0863e-4916-434a-a65d-95e93343e119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a42e497c-0646-4450-9f42-f8da46762273", "tag": "e2c6e6e5-7173-4fde-a2ee-0c73b6a833ac"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:50.387192 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-46ffcf4d-cf56-4fac-8b08-bcdc033938ba req-fee0863e-4916-434a-a65d-95e93343e119 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:50.387632 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-46ffcf4d-cf56-4fac-8b08-bcdc033938ba req-fee0863e-4916-434a-a65d-95e93343e119 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:50.398987 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-46ffcf4d-cf56-4fac-8b08-bcdc033938ba req-fee0863e-4916-434a-a65d-95e93343e119 service nova] Creating event network-changed:e2c6e6e5-7173-4fde-a2ee-0c73b6a833ac for instance a42e497c-0646-4450-9f42-f8da46762273 on hv-cinder-81514 May 26 12:37:50.404630 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-46ffcf4d-cf56-4fac-8b08-bcdc033938ba req-fee0863e-4916-434a-a65d-95e93343e119 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028801 May 26 12:37:50.405673 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 322/657] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:37:50.728983 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-4e1e334c-63c3-4f53-ac10-3cf90218bc1f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:50.729842 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-4e1e334c-63c3-4f53-ac10-3cf90218bc1f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:50.736205 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4e1e334c-63c3-4f53-ac10-3cf90218bc1f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:50.736657 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4e1e334c-63c3-4f53-ac10-3cf90218bc1f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:50.737484 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4e1e334c-63c3-4f53-ac10-3cf90218bc1f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:50.737920 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4e1e334c-63c3-4f53-ac10-3cf90218bc1f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:50.891751 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-4e1e334c-63c3-4f53-ac10-3cf90218bc1f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:50.899934 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-4e1e334c-63c3-4f53-ac10-3cf90218bc1f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:50.901553 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-4e1e334c-63c3-4f53-ac10-3cf90218bc1f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:50.902692 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-4e1e334c-63c3-4f53-ac10-3cf90218bc1f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1723 microversion: 2.20 time: 0.177992 May 26 12:37:50.903454 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 336/658] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:50 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:51.922975 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-825f8f13-ac11-4ea3-b2ee-6ae9a2d8506f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:51.923669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-825f8f13-ac11-4ea3-b2ee-6ae9a2d8506f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:51.931245 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-825f8f13-ac11-4ea3-b2ee-6ae9a2d8506f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:51.931693 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-825f8f13-ac11-4ea3-b2ee-6ae9a2d8506f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:51.932460 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-825f8f13-ac11-4ea3-b2ee-6ae9a2d8506f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:51.932937 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-825f8f13-ac11-4ea3-b2ee-6ae9a2d8506f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:52.098823 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-825f8f13-ac11-4ea3-b2ee-6ae9a2d8506f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:52.106734 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-825f8f13-ac11-4ea3-b2ee-6ae9a2d8506f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:52.108854 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-825f8f13-ac11-4ea3-b2ee-6ae9a2d8506f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:52.110000 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-825f8f13-ac11-4ea3-b2ee-6ae9a2d8506f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1726 microversion: 2.20 time: 0.192505 May 26 12:37:52.110557 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 323/659] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:51 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1726 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:52.128185 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-2a2dc429-90e4-4874-8790-11043f366e34 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90a99a49-9f37-4024-8dcd-62d122232650"}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:52.129294 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-2a2dc429-90e4-4874-8790-11043f366e34 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:52.131267 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:52.136703 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2a2dc429-90e4-4874-8790-11043f366e34 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:52.137183 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2a2dc429-90e4-4874-8790-11043f366e34 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:52.137974 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2a2dc429-90e4-4874-8790-11043f366e34 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:52.138931 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2a2dc429-90e4-4874-8790-11043f366e34 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:52.431433 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-2a2dc429-90e4-4874-8790-11043f366e34 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "POST /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.307017 May 26 12:37:52.436973 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 337/660] 10.222.0.39 () {62 vars in 1363 bytes} [Thu May 26 12:37:52 2022] POST /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c/os-volume_attachments => generated 188 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:37:52.554389 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-52cb549b-e650-4105-af24-9441d7372661 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:52.554945 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-52cb549b-e650-4105-af24-9441d7372661 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:52.561627 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-52cb549b-e650-4105-af24-9441d7372661 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:52.562279 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-52cb549b-e650-4105-af24-9441d7372661 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:52.563262 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-52cb549b-e650-4105-af24-9441d7372661 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:52.563857 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-52cb549b-e650-4105-af24-9441d7372661 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:52.717887 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-52cb549b-e650-4105-af24-9441d7372661 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "POST /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c/action" status: 202 len: 0 microversion: 2.20 time: 0.167285 May 26 12:37:52.718489 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 324/661] 10.222.0.39 () {62 vars in 1318 bytes} [Thu May 26 12:37:52 2022] POST /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 12:37:52.726670 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ac406620-2f4e-4c18-97f7-585c095cac16 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:52.727289 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ac406620-2f4e-4c18-97f7-585c095cac16 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:52.733468 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ac406620-2f4e-4c18-97f7-585c095cac16 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:52.733961 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ac406620-2f4e-4c18-97f7-585c095cac16 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:52.734739 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ac406620-2f4e-4c18-97f7-585c095cac16 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:52.735184 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ac406620-2f4e-4c18-97f7-585c095cac16 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:52.871674 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ac406620-2f4e-4c18-97f7-585c095cac16 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:52.875290 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:52.884671 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ac406620-2f4e-4c18-97f7-585c095cac16 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:52.886482 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ac406620-2f4e-4c18-97f7-585c095cac16 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:52.887651 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ac406620-2f4e-4c18-97f7-585c095cac16 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1752 microversion: 2.20 time: 0.165029 May 26 12:37:52.889530 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 338/662] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:52 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:53.906327 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-17e1d282-3c9f-48cf-a4fa-780a8306f672 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:53.906950 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-17e1d282-3c9f-48cf-a4fa-780a8306f672 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:53.913709 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-17e1d282-3c9f-48cf-a4fa-780a8306f672 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:53.914156 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-17e1d282-3c9f-48cf-a4fa-780a8306f672 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:53.914922 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-17e1d282-3c9f-48cf-a4fa-780a8306f672 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:53.915357 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-17e1d282-3c9f-48cf-a4fa-780a8306f672 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:54.045761 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-17e1d282-3c9f-48cf-a4fa-780a8306f672 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:54.053996 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-17e1d282-3c9f-48cf-a4fa-780a8306f672 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:54.055494 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-17e1d282-3c9f-48cf-a4fa-780a8306f672 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:54.056622 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-17e1d282-3c9f-48cf-a4fa-780a8306f672 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1754 microversion: 2.20 time: 0.154801 May 26 12:37:54.057195 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 325/663] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:53 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:55.076140 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-700aa1a7-cd14-4d04-8bbf-4de5e20f7155 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:55.076780 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-700aa1a7-cd14-4d04-8bbf-4de5e20f7155 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:55.084140 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-700aa1a7-cd14-4d04-8bbf-4de5e20f7155 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:55.084590 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-700aa1a7-cd14-4d04-8bbf-4de5e20f7155 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:55.085400 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-700aa1a7-cd14-4d04-8bbf-4de5e20f7155 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:55.085834 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-700aa1a7-cd14-4d04-8bbf-4de5e20f7155 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:55.223054 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-700aa1a7-cd14-4d04-8bbf-4de5e20f7155 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:55.231255 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-700aa1a7-cd14-4d04-8bbf-4de5e20f7155 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:55.232943 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-700aa1a7-cd14-4d04-8bbf-4de5e20f7155 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:55.234078 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-700aa1a7-cd14-4d04-8bbf-4de5e20f7155 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.162681 May 26 12:37:55.234627 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 339/664] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:55 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:56.251819 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-27177653-e953-480b-921b-3e589993a8a9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:56.252445 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-27177653-e953-480b-921b-3e589993a8a9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:56.254959 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=66 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:56.260189 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-27177653-e953-480b-921b-3e589993a8a9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:56.260635 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-27177653-e953-480b-921b-3e589993a8a9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:56.261666 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-27177653-e953-480b-921b-3e589993a8a9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:56.262099 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-27177653-e953-480b-921b-3e589993a8a9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:56.399527 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-27177653-e953-480b-921b-3e589993a8a9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:56.409248 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-27177653-e953-480b-921b-3e589993a8a9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:56.410790 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-27177653-e953-480b-921b-3e589993a8a9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:56.411933 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-27177653-e953-480b-921b-3e589993a8a9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.164435 May 26 12:37:56.412485 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 326/665] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:56 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:57.430901 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-1193bfa4-50dc-44c1-ae42-cdb7f6160c86 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:57.431515 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-1193bfa4-50dc-44c1-ae42-cdb7f6160c86 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:57.438668 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1193bfa4-50dc-44c1-ae42-cdb7f6160c86 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:57.439116 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1193bfa4-50dc-44c1-ae42-cdb7f6160c86 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:57.439883 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1193bfa4-50dc-44c1-ae42-cdb7f6160c86 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:57.440537 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1193bfa4-50dc-44c1-ae42-cdb7f6160c86 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:57.570530 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-1193bfa4-50dc-44c1-ae42-cdb7f6160c86 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:57.578927 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-1193bfa4-50dc-44c1-ae42-cdb7f6160c86 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:57.580421 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-1193bfa4-50dc-44c1-ae42-cdb7f6160c86 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:57.581590 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-1193bfa4-50dc-44c1-ae42-cdb7f6160c86 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.154684 May 26 12:37:57.582133 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 340/666] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:57 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:58.600427 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-a6aa9f89-2c28-405a-8f76-2a4dcc9cb4ed tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:58.601078 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-a6aa9f89-2c28-405a-8f76-2a4dcc9cb4ed tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:58.608161 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a6aa9f89-2c28-405a-8f76-2a4dcc9cb4ed tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:58.608607 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a6aa9f89-2c28-405a-8f76-2a4dcc9cb4ed tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:58.609411 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a6aa9f89-2c28-405a-8f76-2a4dcc9cb4ed tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:58.609840 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a6aa9f89-2c28-405a-8f76-2a4dcc9cb4ed tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:58.754290 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a6aa9f89-2c28-405a-8f76-2a4dcc9cb4ed tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:58.768828 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a6aa9f89-2c28-405a-8f76-2a4dcc9cb4ed tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:58.768828 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a6aa9f89-2c28-405a-8f76-2a4dcc9cb4ed tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:58.771503 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-a6aa9f89-2c28-405a-8f76-2a4dcc9cb4ed tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.174646 May 26 12:37:58.774501 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 327/667] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:58 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:59.793403 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d9406195-bc2f-4629-b860-75caa0c230da tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:59.794016 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d9406195-bc2f-4629-b860-75caa0c230da tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:37:59.800409 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d9406195-bc2f-4629-b860-75caa0c230da tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:59.800896 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d9406195-bc2f-4629-b860-75caa0c230da tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:59.801672 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d9406195-bc2f-4629-b860-75caa0c230da tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:37:59.802113 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d9406195-bc2f-4629-b860-75caa0c230da tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:37:59.946987 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d9406195-bc2f-4629-b860-75caa0c230da tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:59.956698 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d9406195-bc2f-4629-b860-75caa0c230da tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:59.958231 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d9406195-bc2f-4629-b860-75caa0c230da tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:37:59.959411 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-d9406195-bc2f-4629-b860-75caa0c230da tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.169958 May 26 12:37:59.960002 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 341/668] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:37:59 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:00.977575 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-2df138e1-16fe-410c-afdc-f7f5cd34dd98 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:00.978207 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-2df138e1-16fe-410c-afdc-f7f5cd34dd98 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:00.985379 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2df138e1-16fe-410c-afdc-f7f5cd34dd98 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:00.985834 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2df138e1-16fe-410c-afdc-f7f5cd34dd98 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:00.986608 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2df138e1-16fe-410c-afdc-f7f5cd34dd98 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:00.987046 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2df138e1-16fe-410c-afdc-f7f5cd34dd98 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:01.124562 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2df138e1-16fe-410c-afdc-f7f5cd34dd98 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:01.133652 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2df138e1-16fe-410c-afdc-f7f5cd34dd98 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:01.135178 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2df138e1-16fe-410c-afdc-f7f5cd34dd98 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:01.136607 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-2df138e1-16fe-410c-afdc-f7f5cd34dd98 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.162986 May 26 12:38:01.137214 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 328/669] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:38:00 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:02.156364 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-75cb204d-6bc2-4c79-8940-65b1c5185d8a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:02.157037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-75cb204d-6bc2-4c79-8940-65b1c5185d8a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:02.163989 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-75cb204d-6bc2-4c79-8940-65b1c5185d8a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:02.164435 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-75cb204d-6bc2-4c79-8940-65b1c5185d8a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:02.165227 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-75cb204d-6bc2-4c79-8940-65b1c5185d8a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:02.165664 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-75cb204d-6bc2-4c79-8940-65b1c5185d8a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:02.547114 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-75cb204d-6bc2-4c79-8940-65b1c5185d8a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:02.556204 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-75cb204d-6bc2-4c79-8940-65b1c5185d8a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:02.557896 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-75cb204d-6bc2-4c79-8940-65b1c5185d8a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:02.559163 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-75cb204d-6bc2-4c79-8940-65b1c5185d8a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.407603 May 26 12:38:02.560174 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 342/670] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:38:02 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:03.581368 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-62add2ed-de61-42d6-a3e5-fad1f26fa9ec tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:03.582246 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-62add2ed-de61-42d6-a3e5-fad1f26fa9ec tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:03.589841 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-62add2ed-de61-42d6-a3e5-fad1f26fa9ec tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:03.590288 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-62add2ed-de61-42d6-a3e5-fad1f26fa9ec tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:03.591049 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-62add2ed-de61-42d6-a3e5-fad1f26fa9ec tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:03.591637 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-62add2ed-de61-42d6-a3e5-fad1f26fa9ec tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:03.733641 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-62add2ed-de61-42d6-a3e5-fad1f26fa9ec tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:03.742363 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-62add2ed-de61-42d6-a3e5-fad1f26fa9ec tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:03.743876 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-62add2ed-de61-42d6-a3e5-fad1f26fa9ec tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:03.745070 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-62add2ed-de61-42d6-a3e5-fad1f26fa9ec tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.170855 May 26 12:38:03.745617 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 329/671] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:38:03 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:38:04.764221 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ee13fd9f-476c-423a-9366-ef06a806ef29 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:04.764849 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ee13fd9f-476c-423a-9366-ef06a806ef29 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:04.770891 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ee13fd9f-476c-423a-9366-ef06a806ef29 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:04.771341 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ee13fd9f-476c-423a-9366-ef06a806ef29 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:04.772102 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ee13fd9f-476c-423a-9366-ef06a806ef29 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:04.772540 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ee13fd9f-476c-423a-9366-ef06a806ef29 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:04.911088 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ee13fd9f-476c-423a-9366-ef06a806ef29 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:04.920138 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ee13fd9f-476c-423a-9366-ef06a806ef29 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:04.921716 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ee13fd9f-476c-423a-9366-ef06a806ef29 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:04.922886 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ee13fd9f-476c-423a-9366-ef06a806ef29 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.163431 May 26 12:38:04.923490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 343/672] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:38:04 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:05.947269 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f1f359b6-db06-41ec-b1bd-e1bd212d0c22 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:05.947897 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-f1f359b6-db06-41ec-b1bd-e1bd212d0c22 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:05.955533 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f1f359b6-db06-41ec-b1bd-e1bd212d0c22 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:05.955987 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f1f359b6-db06-41ec-b1bd-e1bd212d0c22 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:05.956783 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f1f359b6-db06-41ec-b1bd-e1bd212d0c22 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:05.957228 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f1f359b6-db06-41ec-b1bd-e1bd212d0c22 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:06.092455 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-f1f359b6-db06-41ec-b1bd-e1bd212d0c22 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:06.101634 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-f1f359b6-db06-41ec-b1bd-e1bd212d0c22 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:06.103186 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-f1f359b6-db06-41ec-b1bd-e1bd212d0c22 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:06.104384 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-f1f359b6-db06-41ec-b1bd-e1bd212d0c22 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.162334 May 26 12:38:06.105215 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 330/673] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:38:05 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:07.126002 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-60400963-357e-4360-817f-3b38d1bf02e4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:07.126621 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-60400963-357e-4360-817f-3b38d1bf02e4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:07.132697 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-60400963-357e-4360-817f-3b38d1bf02e4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:07.133179 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-60400963-357e-4360-817f-3b38d1bf02e4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:07.133947 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-60400963-357e-4360-817f-3b38d1bf02e4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:07.134386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-60400963-357e-4360-817f-3b38d1bf02e4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:07.280964 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-60400963-357e-4360-817f-3b38d1bf02e4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:07.289474 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-60400963-357e-4360-817f-3b38d1bf02e4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:07.290958 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-60400963-357e-4360-817f-3b38d1bf02e4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:07.292098 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-60400963-357e-4360-817f-3b38d1bf02e4 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.172362 May 26 12:38:07.292649 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 344/674] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:38:07 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:08.311863 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-61ac92df-ab10-4492-ac83-fd6cac367fef tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:08.312841 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-61ac92df-ab10-4492-ac83-fd6cac367fef tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:08.319789 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-61ac92df-ab10-4492-ac83-fd6cac367fef tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:08.320239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-61ac92df-ab10-4492-ac83-fd6cac367fef tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:08.321049 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-61ac92df-ab10-4492-ac83-fd6cac367fef tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:08.321488 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-61ac92df-ab10-4492-ac83-fd6cac367fef tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:08.468200 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-61ac92df-ab10-4492-ac83-fd6cac367fef tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:08.476918 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-61ac92df-ab10-4492-ac83-fd6cac367fef tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:08.478524 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-61ac92df-ab10-4492-ac83-fd6cac367fef tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:08.479848 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-61ac92df-ab10-4492-ac83-fd6cac367fef tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.172364 May 26 12:38:08.480591 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 331/675] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:38:08 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:09.499181 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d3f1497c-1467-46d7-bc9f-a8d56d317efa tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:09.501559 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d3f1497c-1467-46d7-bc9f-a8d56d317efa tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:09.516958 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d3f1497c-1467-46d7-bc9f-a8d56d317efa tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:09.517420 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d3f1497c-1467-46d7-bc9f-a8d56d317efa tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:09.518213 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d3f1497c-1467-46d7-bc9f-a8d56d317efa tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:09.518685 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d3f1497c-1467-46d7-bc9f-a8d56d317efa tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:09.651192 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d3f1497c-1467-46d7-bc9f-a8d56d317efa tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:09.660137 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d3f1497c-1467-46d7-bc9f-a8d56d317efa tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:09.661695 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d3f1497c-1467-46d7-bc9f-a8d56d317efa tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:09.662860 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-d3f1497c-1467-46d7-bc9f-a8d56d317efa tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.168156 May 26 12:38:09.663589 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 345/676] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:38:09 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:10.680730 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-a8f2dff1-bb85-4bff-9878-595ce86c5028 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:10.681475 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-a8f2dff1-bb85-4bff-9878-595ce86c5028 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:10.688858 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a8f2dff1-bb85-4bff-9878-595ce86c5028 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:10.689303 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a8f2dff1-bb85-4bff-9878-595ce86c5028 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:10.690056 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a8f2dff1-bb85-4bff-9878-595ce86c5028 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:10.690487 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a8f2dff1-bb85-4bff-9878-595ce86c5028 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:10.784672 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-96443334-9ae2-46fb-9424-5323c49dfc1e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:10.785405 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-96443334-9ae2-46fb-9424-5323c49dfc1e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:10.791173 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-96443334-9ae2-46fb-9424-5323c49dfc1e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:10.791616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-96443334-9ae2-46fb-9424-5323c49dfc1e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:10.792372 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-96443334-9ae2-46fb-9424-5323c49dfc1e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:10.792831 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-96443334-9ae2-46fb-9424-5323c49dfc1e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:10.816288 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-96443334-9ae2-46fb-9424-5323c49dfc1e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3/ips" status: 200 len: 146 microversion: 2.1 time: 0.035347 May 26 12:38:10.816876 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 346/677] 10.222.0.39 () {58 vars in 1247 bytes} [Thu May 26 12:38:10 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:38:10.826836 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a8f2dff1-bb85-4bff-9878-595ce86c5028 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:10.836884 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a8f2dff1-bb85-4bff-9878-595ce86c5028 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:10.838384 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a8f2dff1-bb85-4bff-9878-595ce86c5028 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:10.839518 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-a8f2dff1-bb85-4bff-9878-595ce86c5028 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.162774 May 26 12:38:10.840067 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 332/678] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:38:10 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:11.859574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f30afee2-7859-4965-83c2-8006f1e7b319 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:11.860183 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f30afee2-7859-4965-83c2-8006f1e7b319 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:11.866215 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f30afee2-7859-4965-83c2-8006f1e7b319 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:11.866668 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f30afee2-7859-4965-83c2-8006f1e7b319 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:11.867425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f30afee2-7859-4965-83c2-8006f1e7b319 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:11.867863 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f30afee2-7859-4965-83c2-8006f1e7b319 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:11.999860 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f30afee2-7859-4965-83c2-8006f1e7b319 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:12.008696 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f30afee2-7859-4965-83c2-8006f1e7b319 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:12.010217 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f30afee2-7859-4965-83c2-8006f1e7b319 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:12.011612 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f30afee2-7859-4965-83c2-8006f1e7b319 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.156405 May 26 12:38:12.012155 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 347/679] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:38:11 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:13.030076 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-17358a7a-43a4-4165-922b-2135492a521a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:13.030657 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-17358a7a-43a4-4165-922b-2135492a521a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:13.037065 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-17358a7a-43a4-4165-922b-2135492a521a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:13.037512 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-17358a7a-43a4-4165-922b-2135492a521a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:13.038256 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-17358a7a-43a4-4165-922b-2135492a521a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:13.038688 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-17358a7a-43a4-4165-922b-2135492a521a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:13.169737 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-17358a7a-43a4-4165-922b-2135492a521a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:13.178173 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-17358a7a-43a4-4165-922b-2135492a521a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:13.179693 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-17358a7a-43a4-4165-922b-2135492a521a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:13.180890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-17358a7a-43a4-4165-922b-2135492a521a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.154619 May 26 12:38:13.181449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 333/680] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:38:13 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:14.003587 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-eb7ab6d3-738f-4de8-b58c-7cec304b14db tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bbe03ba-7fef-467d-886d-f20015924335"}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:38:14.004745 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-eb7ab6d3-738f-4de8-b58c-7cec304b14db tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:14.010826 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-eb7ab6d3-738f-4de8-b58c-7cec304b14db tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:14.011270 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-eb7ab6d3-738f-4de8-b58c-7cec304b14db tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:14.012364 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-eb7ab6d3-738f-4de8-b58c-7cec304b14db tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:14.012900 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-eb7ab6d3-738f-4de8-b58c-7cec304b14db tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:14.199374 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-ced4fbb3-95b8-403a-b256-f2eb96c8f074 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:14.199901 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-ced4fbb3-95b8-403a-b256-f2eb96c8f074 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:14.207375 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ced4fbb3-95b8-403a-b256-f2eb96c8f074 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:14.207817 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ced4fbb3-95b8-403a-b256-f2eb96c8f074 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:14.208568 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ced4fbb3-95b8-403a-b256-f2eb96c8f074 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:14.209135 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ced4fbb3-95b8-403a-b256-f2eb96c8f074 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:14.349733 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ced4fbb3-95b8-403a-b256-f2eb96c8f074 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:14.360788 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ced4fbb3-95b8-403a-b256-f2eb96c8f074 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:14.363376 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ced4fbb3-95b8-403a-b256-f2eb96c8f074 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:14.365161 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-ced4fbb3-95b8-403a-b256-f2eb96c8f074 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.169543 May 26 12:38:14.366020 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 334/681] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:38:14 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:38:14.605934 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-eb7ab6d3-738f-4de8-b58c-7cec304b14db tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "POST /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.606838 May 26 12:38:14.606963 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 348/682] 10.222.0.39 () {60 vars in 1322 bytes} [Thu May 26 12:38:13 2022] POST /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3/os-volume_attachments => generated 194 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:15.385219 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-7e3066ef-f53c-4fb6-bd05-d092dfeed773 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:15.386049 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-7e3066ef-f53c-4fb6-bd05-d092dfeed773 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:15.393370 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7e3066ef-f53c-4fb6-bd05-d092dfeed773 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:15.394320 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7e3066ef-f53c-4fb6-bd05-d092dfeed773 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:15.394652 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7e3066ef-f53c-4fb6-bd05-d092dfeed773 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:15.395092 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7e3066ef-f53c-4fb6-bd05-d092dfeed773 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:15.545597 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-7e3066ef-f53c-4fb6-bd05-d092dfeed773 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:15.556158 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-7e3066ef-f53c-4fb6-bd05-d092dfeed773 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:15.557690 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-7e3066ef-f53c-4fb6-bd05-d092dfeed773 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:15.558839 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-7e3066ef-f53c-4fb6-bd05-d092dfeed773 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.177553 May 26 12:38:15.559420 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 335/683] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:38:15 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:38:16.578856 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ed47fb4c-3de7-458c-82eb-f7cf92358e2e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:16.579491 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ed47fb4c-3de7-458c-82eb-f7cf92358e2e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:16.585796 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ed47fb4c-3de7-458c-82eb-f7cf92358e2e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:16.586248 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ed47fb4c-3de7-458c-82eb-f7cf92358e2e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:16.587006 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ed47fb4c-3de7-458c-82eb-f7cf92358e2e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:16.587447 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ed47fb4c-3de7-458c-82eb-f7cf92358e2e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:16.733594 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ed47fb4c-3de7-458c-82eb-f7cf92358e2e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:16.743851 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ed47fb4c-3de7-458c-82eb-f7cf92358e2e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:16.745514 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ed47fb4c-3de7-458c-82eb-f7cf92358e2e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:16.746760 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ed47fb4c-3de7-458c-82eb-f7cf92358e2e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.172840 May 26 12:38:16.747379 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 349/684] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:38:16 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:17.765809 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-75bb2791-6240-4783-9f8c-97684f802c9f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:17.766390 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-75bb2791-6240-4783-9f8c-97684f802c9f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:17.774337 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-75bb2791-6240-4783-9f8c-97684f802c9f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:17.774780 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-75bb2791-6240-4783-9f8c-97684f802c9f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:17.775527 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-75bb2791-6240-4783-9f8c-97684f802c9f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:17.775959 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-75bb2791-6240-4783-9f8c-97684f802c9f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:17.794145 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:17.913248 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-75bb2791-6240-4783-9f8c-97684f802c9f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:17.921744 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-75bb2791-6240-4783-9f8c-97684f802c9f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:17.923868 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-75bb2791-6240-4783-9f8c-97684f802c9f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:17.925787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-75bb2791-6240-4783-9f8c-97684f802c9f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.163816 May 26 12:38:17.926702 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 336/685] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:38:17 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:18.945130 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-c501a686-c879-4074-8c25-06b5a9880363 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:18.945734 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-c501a686-c879-4074-8c25-06b5a9880363 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:18.952346 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c501a686-c879-4074-8c25-06b5a9880363 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:18.952828 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c501a686-c879-4074-8c25-06b5a9880363 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:18.953583 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c501a686-c879-4074-8c25-06b5a9880363 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:18.954020 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c501a686-c879-4074-8c25-06b5a9880363 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:19.087015 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-c501a686-c879-4074-8c25-06b5a9880363 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:19.096280 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-c501a686-c879-4074-8c25-06b5a9880363 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:19.097706 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-c501a686-c879-4074-8c25-06b5a9880363 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:19.098885 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-c501a686-c879-4074-8c25-06b5a9880363 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.157817 May 26 12:38:19.099438 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 350/686] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:38:18 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:20.119061 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b4b41e1c-2eb0-4ac3-8714-cf9855cab861 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:20.119661 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b4b41e1c-2eb0-4ac3-8714-cf9855cab861 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:20.126308 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b4b41e1c-2eb0-4ac3-8714-cf9855cab861 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:20.126756 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b4b41e1c-2eb0-4ac3-8714-cf9855cab861 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:20.127676 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b4b41e1c-2eb0-4ac3-8714-cf9855cab861 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:20.128120 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b4b41e1c-2eb0-4ac3-8714-cf9855cab861 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:20.261886 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b4b41e1c-2eb0-4ac3-8714-cf9855cab861 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:20.270870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b4b41e1c-2eb0-4ac3-8714-cf9855cab861 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:20.272391 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b4b41e1c-2eb0-4ac3-8714-cf9855cab861 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:20.273673 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b4b41e1c-2eb0-4ac3-8714-cf9855cab861 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.160051 May 26 12:38:20.274241 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 337/687] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:38:20 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:21.292641 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-0ff8acb8-3d42-4576-9144-bcecb1bdc731 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:21.293388 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-0ff8acb8-3d42-4576-9144-bcecb1bdc731 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:21.300497 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0ff8acb8-3d42-4576-9144-bcecb1bdc731 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:21.300971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0ff8acb8-3d42-4576-9144-bcecb1bdc731 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:21.301733 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0ff8acb8-3d42-4576-9144-bcecb1bdc731 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:21.302164 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0ff8acb8-3d42-4576-9144-bcecb1bdc731 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:21.438468 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-0ff8acb8-3d42-4576-9144-bcecb1bdc731 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:21.449183 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-0ff8acb8-3d42-4576-9144-bcecb1bdc731 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:21.450715 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-0ff8acb8-3d42-4576-9144-bcecb1bdc731 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:21.451946 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-0ff8acb8-3d42-4576-9144-bcecb1bdc731 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.163158 May 26 12:38:21.452509 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 351/688] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:38:21 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:22.470529 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-40bf1eb0-6bb4-4549-aad8-e5a6fa5eb0fe tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:22.471057 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-40bf1eb0-6bb4-4549-aad8-e5a6fa5eb0fe tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:22.478456 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-40bf1eb0-6bb4-4549-aad8-e5a6fa5eb0fe tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:22.478905 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-40bf1eb0-6bb4-4549-aad8-e5a6fa5eb0fe tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:22.479690 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-40bf1eb0-6bb4-4549-aad8-e5a6fa5eb0fe tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:22.480127 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-40bf1eb0-6bb4-4549-aad8-e5a6fa5eb0fe tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:22.627529 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-40bf1eb0-6bb4-4549-aad8-e5a6fa5eb0fe tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:22.637217 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-40bf1eb0-6bb4-4549-aad8-e5a6fa5eb0fe tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:22.638717 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-40bf1eb0-6bb4-4549-aad8-e5a6fa5eb0fe tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:22.639850 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-40bf1eb0-6bb4-4549-aad8-e5a6fa5eb0fe tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.173324 May 26 12:38:22.640397 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 338/689] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:38:22 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:23.658954 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e4bbe59b-499f-4a87-8c90-eb42e78426b5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:23.660262 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e4bbe59b-499f-4a87-8c90-eb42e78426b5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:23.662993 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=30 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:23.668947 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e4bbe59b-499f-4a87-8c90-eb42e78426b5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:23.669173 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e4bbe59b-499f-4a87-8c90-eb42e78426b5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:23.669856 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e4bbe59b-499f-4a87-8c90-eb42e78426b5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:23.670344 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e4bbe59b-499f-4a87-8c90-eb42e78426b5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:23.801554 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e4bbe59b-499f-4a87-8c90-eb42e78426b5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:23.809995 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e4bbe59b-499f-4a87-8c90-eb42e78426b5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:23.811476 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e4bbe59b-499f-4a87-8c90-eb42e78426b5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:23.812648 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e4bbe59b-499f-4a87-8c90-eb42e78426b5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.157606 May 26 12:38:23.813233 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 352/690] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:38:23 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:24.239040 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-833a93d0-1b86-4a2c-985d-f0e936c362dc tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:38:24.245670 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-833a93d0-1b86-4a2c-985d-f0e936c362dc tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:24.246119 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-833a93d0-1b86-4a2c-985d-f0e936c362dc tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:24.316418 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-833a93d0-1b86-4a2c-985d-f0e936c362dc tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Going to try to stop instance {{(pid=124134) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 12:38:24.359647 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-833a93d0-1b86-4a2c-985d-f0e936c362dc tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "POST /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3/action" status: 202 len: 0 microversion: 2.1 time: 0.125753 May 26 12:38:24.360250 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 339/691] 10.222.0.39 () {60 vars in 1277 bytes} [Thu May 26 12:38:24 2022] POST /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:38:24.369642 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-97b26899-321d-4d99-8f9f-c6b63b15de91 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:24.370279 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-97b26899-321d-4d99-8f9f-c6b63b15de91 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:24.377289 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-97b26899-321d-4d99-8f9f-c6b63b15de91 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:24.377744 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-97b26899-321d-4d99-8f9f-c6b63b15de91 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:24.378868 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-97b26899-321d-4d99-8f9f-c6b63b15de91 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:24.379352 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-97b26899-321d-4d99-8f9f-c6b63b15de91 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:24.520911 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-97b26899-321d-4d99-8f9f-c6b63b15de91 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:24.528977 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-97b26899-321d-4d99-8f9f-c6b63b15de91 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1721 microversion: 2.1 time: 0.163352 May 26 12:38:24.529543 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 353/692] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:38:24 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:38:24.649907 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-190cd59d-6ea0-425f-9721-9a50ecd8ce62 req-c75168e2-bcdf-40c1-a5f1-7aab56ddefdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7af16d0b-59c7-43ea-856c-ec79029b680c", "name": "network-vif-plugged", "status": "completed", "tag": "b1b5ee45-e743-4819-bc49-534e21eec9a7"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:38:24.660377 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-190cd59d-6ea0-425f-9721-9a50ecd8ce62 req-c75168e2-bcdf-40c1-a5f1-7aab56ddefdd service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:24.660897 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-190cd59d-6ea0-425f-9721-9a50ecd8ce62 req-c75168e2-bcdf-40c1-a5f1-7aab56ddefdd service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:24.673613 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-190cd59d-6ea0-425f-9721-9a50ecd8ce62 req-c75168e2-bcdf-40c1-a5f1-7aab56ddefdd service nova] Creating event network-vif-plugged:b1b5ee45-e743-4819-bc49-534e21eec9a7 for instance 7af16d0b-59c7-43ea-856c-ec79029b680c on hv-cinder-81514 May 26 12:38:24.679157 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-190cd59d-6ea0-425f-9721-9a50ecd8ce62 req-c75168e2-bcdf-40c1-a5f1-7aab56ddefdd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102670 May 26 12:38:24.679858 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 340/693] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:24.831954 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-5391ccdb-fa43-414c-a6ea-28b7a186ad32 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:24.832555 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-5391ccdb-fa43-414c-a6ea-28b7a186ad32 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:24.839067 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5391ccdb-fa43-414c-a6ea-28b7a186ad32 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:24.839510 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5391ccdb-fa43-414c-a6ea-28b7a186ad32 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:24.840259 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5391ccdb-fa43-414c-a6ea-28b7a186ad32 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:24.840689 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5391ccdb-fa43-414c-a6ea-28b7a186ad32 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:24.855755 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:24.982898 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-5391ccdb-fa43-414c-a6ea-28b7a186ad32 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:24.991297 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-5391ccdb-fa43-414c-a6ea-28b7a186ad32 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:24.992816 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-5391ccdb-fa43-414c-a6ea-28b7a186ad32 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:24.993945 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-5391ccdb-fa43-414c-a6ea-28b7a186ad32 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.166443 May 26 12:38:24.994486 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 354/694] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:38:24 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:25.547668 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-689a8aea-5009-4439-9190-6c983f853e2a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:25.548357 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-689a8aea-5009-4439-9190-6c983f853e2a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:25.555196 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-689a8aea-5009-4439-9190-6c983f853e2a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:25.555648 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-689a8aea-5009-4439-9190-6c983f853e2a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:25.556408 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-689a8aea-5009-4439-9190-6c983f853e2a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:25.556878 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-689a8aea-5009-4439-9190-6c983f853e2a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:25.709963 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-689a8aea-5009-4439-9190-6c983f853e2a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:25.718005 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-689a8aea-5009-4439-9190-6c983f853e2a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1721 microversion: 2.1 time: 0.175090 May 26 12:38:25.718571 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 341/695] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:38:25 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:26.012628 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-18906e46-d6be-4f16-9b0c-bd4616b91731 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:26.013318 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-18906e46-d6be-4f16-9b0c-bd4616b91731 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:26.023133 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-18906e46-d6be-4f16-9b0c-bd4616b91731 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:26.023662 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-18906e46-d6be-4f16-9b0c-bd4616b91731 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:26.024550 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-18906e46-d6be-4f16-9b0c-bd4616b91731 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:26.025110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-18906e46-d6be-4f16-9b0c-bd4616b91731 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:26.163430 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-18906e46-d6be-4f16-9b0c-bd4616b91731 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:26.172066 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-18906e46-d6be-4f16-9b0c-bd4616b91731 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:26.173621 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-18906e46-d6be-4f16-9b0c-bd4616b91731 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:26.175699 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-18906e46-d6be-4f16-9b0c-bd4616b91731 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.166583 May 26 12:38:26.176373 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 355/696] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:38:26 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:26.735709 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-4eac672d-6d12-4100-8b43-ec727d79ab1e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:26.736312 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-4eac672d-6d12-4100-8b43-ec727d79ab1e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:26.739594 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=32 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:26.744981 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4eac672d-6d12-4100-8b43-ec727d79ab1e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:26.745430 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4eac672d-6d12-4100-8b43-ec727d79ab1e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:26.746241 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4eac672d-6d12-4100-8b43-ec727d79ab1e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:26.746790 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4eac672d-6d12-4100-8b43-ec727d79ab1e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:26.881155 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-4eac672d-6d12-4100-8b43-ec727d79ab1e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:26.889506 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-4eac672d-6d12-4100-8b43-ec727d79ab1e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1721 microversion: 2.1 time: 0.157627 May 26 12:38:26.890072 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 342/697] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:38:26 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:27.195652 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-04c0a9a3-8651-4db9-86b8-64b7e55b8fa8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:27.196186 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-04c0a9a3-8651-4db9-86b8-64b7e55b8fa8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:27.202772 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-04c0a9a3-8651-4db9-86b8-64b7e55b8fa8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:27.203220 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-04c0a9a3-8651-4db9-86b8-64b7e55b8fa8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:27.203978 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-04c0a9a3-8651-4db9-86b8-64b7e55b8fa8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:27.204414 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-04c0a9a3-8651-4db9-86b8-64b7e55b8fa8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:27.340557 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-04c0a9a3-8651-4db9-86b8-64b7e55b8fa8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:27.349375 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-04c0a9a3-8651-4db9-86b8-64b7e55b8fa8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:27.350865 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-04c0a9a3-8651-4db9-86b8-64b7e55b8fa8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:27.351999 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-04c0a9a3-8651-4db9-86b8-64b7e55b8fa8 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.160336 May 26 12:38:27.352554 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 356/698] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:38:27 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:27.907551 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-d9fb2c50-388d-49e2-82d0-a218a9606b61 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:27.908139 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-d9fb2c50-388d-49e2-82d0-a218a9606b61 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:27.915678 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d9fb2c50-388d-49e2-82d0-a218a9606b61 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:27.916123 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d9fb2c50-388d-49e2-82d0-a218a9606b61 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:27.916927 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d9fb2c50-388d-49e2-82d0-a218a9606b61 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:27.917362 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d9fb2c50-388d-49e2-82d0-a218a9606b61 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:28.057100 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d9fb2c50-388d-49e2-82d0-a218a9606b61 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:28.066253 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-d9fb2c50-388d-49e2-82d0-a218a9606b61 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1721 microversion: 2.1 time: 0.162079 May 26 12:38:28.066813 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 343/699] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:38:27 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:28.370879 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-55300131-6248-4152-9b39-7a3a78887fa3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:28.371547 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-55300131-6248-4152-9b39-7a3a78887fa3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:28.380308 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-55300131-6248-4152-9b39-7a3a78887fa3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:28.380692 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-55300131-6248-4152-9b39-7a3a78887fa3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:28.381833 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-55300131-6248-4152-9b39-7a3a78887fa3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:28.382324 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-55300131-6248-4152-9b39-7a3a78887fa3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:28.594025 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-55300131-6248-4152-9b39-7a3a78887fa3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:28.602727 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-55300131-6248-4152-9b39-7a3a78887fa3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:28.604227 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-55300131-6248-4152-9b39-7a3a78887fa3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:28.605643 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-55300131-6248-4152-9b39-7a3a78887fa3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1810 microversion: 2.20 time: 0.239060 May 26 12:38:28.606352 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 357/700] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:38:28 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1810 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:29.084498 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f3d4df5d-3409-47de-bfd0-1d9257480b48 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:29.085103 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-f3d4df5d-3409-47de-bfd0-1d9257480b48 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:29.092093 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f3d4df5d-3409-47de-bfd0-1d9257480b48 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:29.092551 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f3d4df5d-3409-47de-bfd0-1d9257480b48 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:29.093354 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f3d4df5d-3409-47de-bfd0-1d9257480b48 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:29.093795 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f3d4df5d-3409-47de-bfd0-1d9257480b48 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:29.239398 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-f3d4df5d-3409-47de-bfd0-1d9257480b48 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:29.248495 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-f3d4df5d-3409-47de-bfd0-1d9257480b48 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1721 microversion: 2.1 time: 0.168785 May 26 12:38:29.249154 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 344/701] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:38:29 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:29.624974 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-dba49ca1-355a-479c-9535-2a347626ec46 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:29.625581 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-dba49ca1-355a-479c-9535-2a347626ec46 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:29.632922 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dba49ca1-355a-479c-9535-2a347626ec46 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:29.633375 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dba49ca1-355a-479c-9535-2a347626ec46 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:29.634142 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dba49ca1-355a-479c-9535-2a347626ec46 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:29.634582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dba49ca1-355a-479c-9535-2a347626ec46 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:29.789141 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-dba49ca1-355a-479c-9535-2a347626ec46 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:29.798192 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-dba49ca1-355a-479c-9535-2a347626ec46 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:29.800338 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-dba49ca1-355a-479c-9535-2a347626ec46 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:29.801689 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-dba49ca1-355a-479c-9535-2a347626ec46 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1797 microversion: 2.20 time: 0.180693 May 26 12:38:29.802404 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 358/702] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:38:29 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1797 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:30.269574 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-41fc32ae-8e3a-4d38-9e7b-b2002f81f7d3 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:30.270317 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-41fc32ae-8e3a-4d38-9e7b-b2002f81f7d3 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:30.277076 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-41fc32ae-8e3a-4d38-9e7b-b2002f81f7d3 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:30.277605 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-41fc32ae-8e3a-4d38-9e7b-b2002f81f7d3 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:30.278476 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-41fc32ae-8e3a-4d38-9e7b-b2002f81f7d3 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:30.279013 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-41fc32ae-8e3a-4d38-9e7b-b2002f81f7d3 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:30.427275 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-41fc32ae-8e3a-4d38-9e7b-b2002f81f7d3 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:30.435225 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-41fc32ae-8e3a-4d38-9e7b-b2002f81f7d3 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1721 microversion: 2.1 time: 0.169650 May 26 12:38:30.435793 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 345/703] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:38:30 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:31.452687 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-98029ecc-fd71-4421-b3e0-59c33908f1df tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:31.453317 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-98029ecc-fd71-4421-b3e0-59c33908f1df tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:31.460171 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-98029ecc-fd71-4421-b3e0-59c33908f1df tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:31.460625 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-98029ecc-fd71-4421-b3e0-59c33908f1df tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:31.461423 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-98029ecc-fd71-4421-b3e0-59c33908f1df tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:31.461866 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-98029ecc-fd71-4421-b3e0-59c33908f1df tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:31.608190 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-98029ecc-fd71-4421-b3e0-59c33908f1df tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:31.616699 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-98029ecc-fd71-4421-b3e0-59c33908f1df tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1721 microversion: 2.1 time: 0.167894 May 26 12:38:31.617278 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 359/704] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:38:31 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:32.634130 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-7653a7af-e13b-41aa-b651-a77037c1e4e2 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:32.634785 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-7653a7af-e13b-41aa-b651-a77037c1e4e2 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:32.641534 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7653a7af-e13b-41aa-b651-a77037c1e4e2 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:32.641979 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7653a7af-e13b-41aa-b651-a77037c1e4e2 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:32.642736 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7653a7af-e13b-41aa-b651-a77037c1e4e2 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:32.643166 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7653a7af-e13b-41aa-b651-a77037c1e4e2 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:32.780586 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-7653a7af-e13b-41aa-b651-a77037c1e4e2 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:32.794346 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-7653a7af-e13b-41aa-b651-a77037c1e4e2 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1721 microversion: 2.1 time: 0.163739 May 26 12:38:32.795304 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 346/705] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:38:32 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:33.814304 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-2827ef6f-335e-44d8-baab-807a20faa545 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:33.815170 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-2827ef6f-335e-44d8-baab-807a20faa545 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:33.823439 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2827ef6f-335e-44d8-baab-807a20faa545 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:33.823892 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2827ef6f-335e-44d8-baab-807a20faa545 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:33.824688 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2827ef6f-335e-44d8-baab-807a20faa545 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:33.825246 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2827ef6f-335e-44d8-baab-807a20faa545 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:33.964675 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-2827ef6f-335e-44d8-baab-807a20faa545 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:33.972688 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-2827ef6f-335e-44d8-baab-807a20faa545 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1721 microversion: 2.1 time: 0.164376 May 26 12:38:33.973270 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 360/706] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:38:33 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:38:34.990275 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-5abd198d-fcbf-45bd-9305-b772806cd9f6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:34.990880 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-5abd198d-fcbf-45bd-9305-b772806cd9f6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:34.997615 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5abd198d-fcbf-45bd-9305-b772806cd9f6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:34.998066 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5abd198d-fcbf-45bd-9305-b772806cd9f6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:34.998838 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5abd198d-fcbf-45bd-9305-b772806cd9f6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:34.999277 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5abd198d-fcbf-45bd-9305-b772806cd9f6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:35.137954 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-5abd198d-fcbf-45bd-9305-b772806cd9f6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:35.146236 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-5abd198d-fcbf-45bd-9305-b772806cd9f6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1721 microversion: 2.1 time: 0.160270 May 26 12:38:35.146756 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 347/707] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:38:34 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:36.164325 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-5aa48129-a782-45ab-8ff4-3d1172a6a303 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:36.164907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-5aa48129-a782-45ab-8ff4-3d1172a6a303 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:36.171564 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5aa48129-a782-45ab-8ff4-3d1172a6a303 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:36.172010 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5aa48129-a782-45ab-8ff4-3d1172a6a303 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:36.172796 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5aa48129-a782-45ab-8ff4-3d1172a6a303 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:36.173242 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5aa48129-a782-45ab-8ff4-3d1172a6a303 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:36.311937 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-5aa48129-a782-45ab-8ff4-3d1172a6a303 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:36.320328 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-5aa48129-a782-45ab-8ff4-3d1172a6a303 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1721 microversion: 2.1 time: 0.160301 May 26 12:38:36.320916 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 361/708] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:38:36 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:37.338257 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-166fbf2d-e980-4754-9659-fad721107a76 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:37.338923 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-166fbf2d-e980-4754-9659-fad721107a76 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:37.345878 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-166fbf2d-e980-4754-9659-fad721107a76 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:37.346366 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-166fbf2d-e980-4754-9659-fad721107a76 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:37.347255 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-166fbf2d-e980-4754-9659-fad721107a76 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:37.347733 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-166fbf2d-e980-4754-9659-fad721107a76 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:37.483743 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-166fbf2d-e980-4754-9659-fad721107a76 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:37.492739 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-166fbf2d-e980-4754-9659-fad721107a76 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1721 microversion: 2.1 time: 0.158640 May 26 12:38:37.493315 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 348/709] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:38:37 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:38.509131 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f9f51a35-6909-4827-8e91-334eb270d6e0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:38.509736 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f9f51a35-6909-4827-8e91-334eb270d6e0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:38.516498 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f9f51a35-6909-4827-8e91-334eb270d6e0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:38.516973 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f9f51a35-6909-4827-8e91-334eb270d6e0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:38.517732 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f9f51a35-6909-4827-8e91-334eb270d6e0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:38.518166 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f9f51a35-6909-4827-8e91-334eb270d6e0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:38.656898 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f9f51a35-6909-4827-8e91-334eb270d6e0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:38.665474 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f9f51a35-6909-4827-8e91-334eb270d6e0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1721 microversion: 2.1 time: 0.160214 May 26 12:38:38.666076 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 362/710] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:38:38 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:39.683485 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-80109bb1-1d0c-4cbf-b301-7b62e0713055 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:39.684118 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-80109bb1-1d0c-4cbf-b301-7b62e0713055 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:39.691842 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-80109bb1-1d0c-4cbf-b301-7b62e0713055 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:39.692293 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-80109bb1-1d0c-4cbf-b301-7b62e0713055 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:39.693102 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-80109bb1-1d0c-4cbf-b301-7b62e0713055 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:39.693546 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-80109bb1-1d0c-4cbf-b301-7b62e0713055 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:39.828832 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-80109bb1-1d0c-4cbf-b301-7b62e0713055 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:39.837789 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-80109bb1-1d0c-4cbf-b301-7b62e0713055 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1721 microversion: 2.1 time: 0.158102 May 26 12:38:39.838728 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 349/711] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:38:39 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:40.855639 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ea8746b1-7da1-4e2c-a2d6-05cafb126e4d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:40.856268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ea8746b1-7da1-4e2c-a2d6-05cafb126e4d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:40.863877 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ea8746b1-7da1-4e2c-a2d6-05cafb126e4d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:40.864340 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ea8746b1-7da1-4e2c-a2d6-05cafb126e4d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:40.865150 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ea8746b1-7da1-4e2c-a2d6-05cafb126e4d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:40.865603 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ea8746b1-7da1-4e2c-a2d6-05cafb126e4d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:40.995069 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ea8746b1-7da1-4e2c-a2d6-05cafb126e4d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:41.003823 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ea8746b1-7da1-4e2c-a2d6-05cafb126e4d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1698 microversion: 2.1 time: 0.151296 May 26 12:38:41.004393 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 363/712] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:38:40 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1698 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:38:41.020322 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6e4dbf9f-79ea-4979-abb0-34b9dabf5ac5 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:38:41.026918 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6e4dbf9f-79ea-4979-abb0-34b9dabf5ac5 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:41.027365 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6e4dbf9f-79ea-4979-abb0-34b9dabf5ac5 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:41.049027 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-6e4dbf9f-79ea-4979-abb0-34b9dabf5ac5 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Going to try to start instance {{(pid=124134) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 12:38:41.090534 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-6e4dbf9f-79ea-4979-abb0-34b9dabf5ac5 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "POST /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3/action" status: 202 len: 0 microversion: 2.1 time: 0.073954 May 26 12:38:41.091167 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 350/713] 10.222.0.39 () {60 vars in 1277 bytes} [Thu May 26 12:38:41 2022] POST /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:38:41.099757 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-78fb7b64-f3fd-4bc3-814d-9d5e36973017 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:41.100366 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-78fb7b64-f3fd-4bc3-814d-9d5e36973017 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:41.106373 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-78fb7b64-f3fd-4bc3-814d-9d5e36973017 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:41.106757 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-78fb7b64-f3fd-4bc3-814d-9d5e36973017 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:41.107517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-78fb7b64-f3fd-4bc3-814d-9d5e36973017 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:41.107958 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-78fb7b64-f3fd-4bc3-814d-9d5e36973017 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:41.244802 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-78fb7b64-f3fd-4bc3-814d-9d5e36973017 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:41.254490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-78fb7b64-f3fd-4bc3-814d-9d5e36973017 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1707 microversion: 2.1 time: 0.158706 May 26 12:38:41.255054 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 364/714] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:38:41 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1707 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:42.272488 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-0c9b0ad1-43e0-40ab-8275-8ba4cd73f6d2 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:42.273214 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-0c9b0ad1-43e0-40ab-8275-8ba4cd73f6d2 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:42.279498 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0c9b0ad1-43e0-40ab-8275-8ba4cd73f6d2 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:42.279951 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0c9b0ad1-43e0-40ab-8275-8ba4cd73f6d2 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:42.280736 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0c9b0ad1-43e0-40ab-8275-8ba4cd73f6d2 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:42.281187 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0c9b0ad1-43e0-40ab-8275-8ba4cd73f6d2 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:42.421897 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-0c9b0ad1-43e0-40ab-8275-8ba4cd73f6d2 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:42.426110 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:42.431639 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-0c9b0ad1-43e0-40ab-8275-8ba4cd73f6d2 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1707 microversion: 2.1 time: 0.163858 May 26 12:38:42.432215 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 351/715] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:38:42 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1707 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:43.449100 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-2b75f1f9-4d77-44c5-af25-1fba471ab23f tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:43.449691 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-2b75f1f9-4d77-44c5-af25-1fba471ab23f tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:43.457111 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2b75f1f9-4d77-44c5-af25-1fba471ab23f tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:43.457558 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2b75f1f9-4d77-44c5-af25-1fba471ab23f tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:43.458323 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2b75f1f9-4d77-44c5-af25-1fba471ab23f tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:43.458759 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2b75f1f9-4d77-44c5-af25-1fba471ab23f tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:43.600547 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-2b75f1f9-4d77-44c5-af25-1fba471ab23f tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:43.616801 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-2b75f1f9-4d77-44c5-af25-1fba471ab23f tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1707 microversion: 2.1 time: 0.171412 May 26 12:38:43.617370 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 365/716] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:38:43 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1707 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:44.637457 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-d0a6e2ec-2210-4a9c-915e-f492f8909a41 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:44.637996 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-d0a6e2ec-2210-4a9c-915e-f492f8909a41 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:44.646219 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d0a6e2ec-2210-4a9c-915e-f492f8909a41 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:44.646671 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d0a6e2ec-2210-4a9c-915e-f492f8909a41 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:44.647449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d0a6e2ec-2210-4a9c-915e-f492f8909a41 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:44.647889 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d0a6e2ec-2210-4a9c-915e-f492f8909a41 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:44.781722 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d0a6e2ec-2210-4a9c-915e-f492f8909a41 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:44.790849 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-d0a6e2ec-2210-4a9c-915e-f492f8909a41 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1711 microversion: 2.1 time: 0.159393 May 26 12:38:44.791416 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 352/717] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:38:44 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1711 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:45.561807 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-117ead45-be05-480b-b388-5383fb3231c9 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "650941cf-0d0e-4747-b103-539eda008a74"}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:38:45.562956 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-117ead45-be05-480b-b388-5383fb3231c9 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:45.573523 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-117ead45-be05-480b-b388-5383fb3231c9 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:45.573991 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-117ead45-be05-480b-b388-5383fb3231c9 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:45.574783 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-117ead45-be05-480b-b388-5383fb3231c9 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:45.575222 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-117ead45-be05-480b-b388-5383fb3231c9 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:45.880145 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-117ead45-be05-480b-b388-5383fb3231c9 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "POST /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.431055 May 26 12:38:45.880638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 366/718] 10.222.0.39 () {60 vars in 1322 bytes} [Thu May 26 12:38:45 2022] POST /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3/os-volume_attachments => generated 194 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:53.412590 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-c39dd818-19b6-49ef-beb2-e64a415f5945 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:38:53.413578 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-c39dd818-19b6-49ef-beb2-e64a415f5945 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:53.420328 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c39dd818-19b6-49ef-beb2-e64a415f5945 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:53.420812 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c39dd818-19b6-49ef-beb2-e64a415f5945 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:53.421583 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c39dd818-19b6-49ef-beb2-e64a415f5945 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:53.422022 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c39dd818-19b6-49ef-beb2-e64a415f5945 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:53.448591 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.objects.instance [None req-c39dd818-19b6-49ef-beb2-e64a415f5945 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lazy-loading 'flavor' on Instance uuid c221b67a-627a-485b-9790-4de1b4c73aa3 {{(pid=124134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:38:53.577806 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-c39dd818-19b6-49ef-beb2-e64a415f5945 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "POST /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3/action" status: 200 len: 32 microversion: 2.1 time: 0.169497 May 26 12:38:53.578469 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 353/719] 10.222.0.39 () {60 vars in 1277 bytes} [Thu May 26 12:38:53 2022] POST /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3/action => generated 32 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:38:53.588699 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-283e18aa-87df-449d-93e6-5b05e950e6e3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:53.589482 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-283e18aa-87df-449d-93e6-5b05e950e6e3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:53.596832 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-283e18aa-87df-449d-93e6-5b05e950e6e3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:53.597437 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-283e18aa-87df-449d-93e6-5b05e950e6e3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:53.598318 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-283e18aa-87df-449d-93e6-5b05e950e6e3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:53.598790 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-283e18aa-87df-449d-93e6-5b05e950e6e3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:53.828563 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-283e18aa-87df-449d-93e6-5b05e950e6e3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:53.837487 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-283e18aa-87df-449d-93e6-5b05e950e6e3 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1738 microversion: 2.1 time: 0.252932 May 26 12:38:53.838069 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 367/720] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:38:53 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1738 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:54.856315 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-7c718aec-eea5-4bcc-a562-82c5afcd669f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:54.857066 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-7c718aec-eea5-4bcc-a562-82c5afcd669f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:54.864159 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7c718aec-eea5-4bcc-a562-82c5afcd669f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:54.864601 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7c718aec-eea5-4bcc-a562-82c5afcd669f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:54.865469 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7c718aec-eea5-4bcc-a562-82c5afcd669f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:54.865906 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7c718aec-eea5-4bcc-a562-82c5afcd669f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:55.007549 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-7c718aec-eea5-4bcc-a562-82c5afcd669f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:55.015871 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-7c718aec-eea5-4bcc-a562-82c5afcd669f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1738 microversion: 2.1 time: 0.164109 May 26 12:38:55.016438 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 354/721] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:38:54 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:56.034087 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-6004be9a-ddee-4b6a-88e0-75775eeb9008 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:56.034735 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-6004be9a-ddee-4b6a-88e0-75775eeb9008 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:56.037317 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=32 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:56.042759 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6004be9a-ddee-4b6a-88e0-75775eeb9008 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:56.043216 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6004be9a-ddee-4b6a-88e0-75775eeb9008 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:56.044028 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6004be9a-ddee-4b6a-88e0-75775eeb9008 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:56.044473 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6004be9a-ddee-4b6a-88e0-75775eeb9008 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:56.047342 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:56.181850 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-6004be9a-ddee-4b6a-88e0-75775eeb9008 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:56.190083 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-6004be9a-ddee-4b6a-88e0-75775eeb9008 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1738 microversion: 2.1 time: 0.160345 May 26 12:38:56.190732 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 368/722] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:38:56 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:57.207531 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-2ab0ff26-c0dd-4312-9043-71578f94dda4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:57.208143 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-2ab0ff26-c0dd-4312-9043-71578f94dda4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:57.210514 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=26 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:57.216000 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2ab0ff26-c0dd-4312-9043-71578f94dda4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:57.216480 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2ab0ff26-c0dd-4312-9043-71578f94dda4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:57.217287 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2ab0ff26-c0dd-4312-9043-71578f94dda4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:57.217729 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2ab0ff26-c0dd-4312-9043-71578f94dda4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:57.350631 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2ab0ff26-c0dd-4312-9043-71578f94dda4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:57.358687 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-2ab0ff26-c0dd-4312-9043-71578f94dda4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1738 microversion: 2.1 time: 0.155359 May 26 12:38:57.359280 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 355/723] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:38:57 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:58.376629 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f8716665-3ef2-432e-91e1-fbd9b8948ab1 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:58.377563 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f8716665-3ef2-432e-91e1-fbd9b8948ab1 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:58.384040 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f8716665-3ef2-432e-91e1-fbd9b8948ab1 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:58.384490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f8716665-3ef2-432e-91e1-fbd9b8948ab1 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:58.385307 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f8716665-3ef2-432e-91e1-fbd9b8948ab1 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:58.385745 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f8716665-3ef2-432e-91e1-fbd9b8948ab1 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:58.517294 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f8716665-3ef2-432e-91e1-fbd9b8948ab1 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:58.525793 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f8716665-3ef2-432e-91e1-fbd9b8948ab1 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1738 microversion: 2.1 time: 0.153106 May 26 12:38:58.526350 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 369/724] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:38:58 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:59.543417 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-078dc6f3-e7f3-42d8-aa15-f53f49894789 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:59.544007 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-078dc6f3-e7f3-42d8-aa15-f53f49894789 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:38:59.550527 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-078dc6f3-e7f3-42d8-aa15-f53f49894789 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:59.550973 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-078dc6f3-e7f3-42d8-aa15-f53f49894789 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:59.551737 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-078dc6f3-e7f3-42d8-aa15-f53f49894789 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:38:59.552172 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-078dc6f3-e7f3-42d8-aa15-f53f49894789 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:38:59.685098 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-078dc6f3-e7f3-42d8-aa15-f53f49894789 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:38:59.694347 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-078dc6f3-e7f3-42d8-aa15-f53f49894789 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1738 microversion: 2.1 time: 0.154748 May 26 12:38:59.694957 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 356/725] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:38:59 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:00.711568 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-88fcd8de-3dc0-4372-931f-c71a463c801e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:00.712184 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-88fcd8de-3dc0-4372-931f-c71a463c801e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:00.718761 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-88fcd8de-3dc0-4372-931f-c71a463c801e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:00.719215 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-88fcd8de-3dc0-4372-931f-c71a463c801e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:00.719999 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-88fcd8de-3dc0-4372-931f-c71a463c801e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:00.720444 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-88fcd8de-3dc0-4372-931f-c71a463c801e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:00.849419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-88fcd8de-3dc0-4372-931f-c71a463c801e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:00.857316 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-88fcd8de-3dc0-4372-931f-c71a463c801e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1738 microversion: 2.1 time: 0.149590 May 26 12:39:00.857885 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 370/726] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:00 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:01.875070 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-d63738f2-1192-48b9-a3a8-479deb042311 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:01.875681 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-d63738f2-1192-48b9-a3a8-479deb042311 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:01.883088 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d63738f2-1192-48b9-a3a8-479deb042311 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:01.883547 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d63738f2-1192-48b9-a3a8-479deb042311 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:01.884336 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d63738f2-1192-48b9-a3a8-479deb042311 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:01.884805 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d63738f2-1192-48b9-a3a8-479deb042311 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:02.020665 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d63738f2-1192-48b9-a3a8-479deb042311 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:02.035134 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-d63738f2-1192-48b9-a3a8-479deb042311 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1738 microversion: 2.1 time: 0.163815 May 26 12:39:02.035727 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 357/727] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:01 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:03.053128 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-199ce305-e9d5-4004-af3f-c11f42f81277 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:03.053727 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-199ce305-e9d5-4004-af3f-c11f42f81277 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:03.060441 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-199ce305-e9d5-4004-af3f-c11f42f81277 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:03.060924 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-199ce305-e9d5-4004-af3f-c11f42f81277 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:03.061696 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-199ce305-e9d5-4004-af3f-c11f42f81277 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:03.062130 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-199ce305-e9d5-4004-af3f-c11f42f81277 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:03.194788 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-199ce305-e9d5-4004-af3f-c11f42f81277 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:03.202655 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-199ce305-e9d5-4004-af3f-c11f42f81277 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1738 microversion: 2.1 time: 0.153977 May 26 12:39:03.203208 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 371/728] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:03 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:04.219723 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-3dedce14-a362-4ce7-a0ff-4c4bdb6f2d53 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:04.220329 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-3dedce14-a362-4ce7-a0ff-4c4bdb6f2d53 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:04.227783 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3dedce14-a362-4ce7-a0ff-4c4bdb6f2d53 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:04.228235 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3dedce14-a362-4ce7-a0ff-4c4bdb6f2d53 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:04.229027 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3dedce14-a362-4ce7-a0ff-4c4bdb6f2d53 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:04.229475 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3dedce14-a362-4ce7-a0ff-4c4bdb6f2d53 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:04.362043 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-3dedce14-a362-4ce7-a0ff-4c4bdb6f2d53 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:04.370340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-3dedce14-a362-4ce7-a0ff-4c4bdb6f2d53 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1738 microversion: 2.1 time: 0.154393 May 26 12:39:04.370919 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 358/729] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:04 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:05.387755 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-7a6fb883-7c05-4f21-9988-013c635e19d8 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:05.388363 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-7a6fb883-7c05-4f21-9988-013c635e19d8 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:05.395754 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7a6fb883-7c05-4f21-9988-013c635e19d8 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:05.396206 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7a6fb883-7c05-4f21-9988-013c635e19d8 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:05.397001 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7a6fb883-7c05-4f21-9988-013c635e19d8 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:05.397441 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7a6fb883-7c05-4f21-9988-013c635e19d8 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:05.530333 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-7a6fb883-7c05-4f21-9988-013c635e19d8 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:05.538660 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-7a6fb883-7c05-4f21-9988-013c635e19d8 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1738 microversion: 2.1 time: 0.155027 May 26 12:39:05.539215 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 372/730] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:05 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:06.555889 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-0622160c-3bd4-458f-88f7-7918e49d7d1a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:06.556440 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-0622160c-3bd4-458f-88f7-7918e49d7d1a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:06.563106 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0622160c-3bd4-458f-88f7-7918e49d7d1a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:06.563558 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0622160c-3bd4-458f-88f7-7918e49d7d1a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:06.564327 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0622160c-3bd4-458f-88f7-7918e49d7d1a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:06.565353 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0622160c-3bd4-458f-88f7-7918e49d7d1a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:06.697651 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-0622160c-3bd4-458f-88f7-7918e49d7d1a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:06.707224 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-0622160c-3bd4-458f-88f7-7918e49d7d1a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1738 microversion: 2.1 time: 0.155331 May 26 12:39:06.707800 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 359/731] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:06 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:07.725397 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-95b72b12-02dc-4825-97d1-33e9cd5bcf2d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:07.726007 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-95b72b12-02dc-4825-97d1-33e9cd5bcf2d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:07.732100 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-95b72b12-02dc-4825-97d1-33e9cd5bcf2d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:07.732550 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-95b72b12-02dc-4825-97d1-33e9cd5bcf2d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:07.733334 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-95b72b12-02dc-4825-97d1-33e9cd5bcf2d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:07.733772 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-95b72b12-02dc-4825-97d1-33e9cd5bcf2d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:07.875632 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-95b72b12-02dc-4825-97d1-33e9cd5bcf2d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:07.884285 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-95b72b12-02dc-4825-97d1-33e9cd5bcf2d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1738 microversion: 2.1 time: 0.163849 May 26 12:39:07.885084 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 373/732] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:07 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:08.902168 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b21b74fb-57ff-4319-a96a-688f411c3f66 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:08.902771 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b21b74fb-57ff-4319-a96a-688f411c3f66 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:08.909989 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b21b74fb-57ff-4319-a96a-688f411c3f66 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:08.910441 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b21b74fb-57ff-4319-a96a-688f411c3f66 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:08.911200 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b21b74fb-57ff-4319-a96a-688f411c3f66 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:08.911631 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b21b74fb-57ff-4319-a96a-688f411c3f66 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:09.040365 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b21b74fb-57ff-4319-a96a-688f411c3f66 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:09.048231 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b21b74fb-57ff-4319-a96a-688f411c3f66 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1738 microversion: 2.1 time: 0.149897 May 26 12:39:09.048806 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 360/733] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:08 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:10.065742 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-b5c1f8f3-afea-404a-a457-85504459193e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:10.067006 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-b5c1f8f3-afea-404a-a457-85504459193e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:10.073568 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b5c1f8f3-afea-404a-a457-85504459193e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:10.074017 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b5c1f8f3-afea-404a-a457-85504459193e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:10.074777 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b5c1f8f3-afea-404a-a457-85504459193e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:10.075216 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b5c1f8f3-afea-404a-a457-85504459193e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:10.204056 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-b5c1f8f3-afea-404a-a457-85504459193e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:10.212168 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-b5c1f8f3-afea-404a-a457-85504459193e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1738 microversion: 2.1 time: 0.150277 May 26 12:39:10.212736 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 374/734] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:10 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:11.229696 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-54602e2a-cb09-4c60-ab22-1184ab29baf6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:11.230300 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-54602e2a-cb09-4c60-ab22-1184ab29baf6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:11.236921 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-54602e2a-cb09-4c60-ab22-1184ab29baf6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:11.237370 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-54602e2a-cb09-4c60-ab22-1184ab29baf6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:11.238122 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-54602e2a-cb09-4c60-ab22-1184ab29baf6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:11.238557 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-54602e2a-cb09-4c60-ab22-1184ab29baf6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:11.365235 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-54602e2a-cb09-4c60-ab22-1184ab29baf6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:11.373682 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-54602e2a-cb09-4c60-ab22-1184ab29baf6 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1738 microversion: 2.1 time: 0.148545 May 26 12:39:11.374237 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 361/735] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:11 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:12.391025 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d2534f63-dc11-456b-a705-6b143e1a9c0b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:12.391630 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d2534f63-dc11-456b-a705-6b143e1a9c0b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:12.398370 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d2534f63-dc11-456b-a705-6b143e1a9c0b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:12.398824 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d2534f63-dc11-456b-a705-6b143e1a9c0b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:12.399592 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d2534f63-dc11-456b-a705-6b143e1a9c0b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:12.400036 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d2534f63-dc11-456b-a705-6b143e1a9c0b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:12.537052 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d2534f63-dc11-456b-a705-6b143e1a9c0b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:12.545564 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-d2534f63-dc11-456b-a705-6b143e1a9c0b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1738 microversion: 2.1 time: 0.158581 May 26 12:39:12.546126 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 375/736] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:12 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:13.563722 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-06df647b-ec3b-4cb0-aac5-eaf0bd3f567d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:13.564402 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-06df647b-ec3b-4cb0-aac5-eaf0bd3f567d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:13.571360 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-06df647b-ec3b-4cb0-aac5-eaf0bd3f567d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:13.571844 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-06df647b-ec3b-4cb0-aac5-eaf0bd3f567d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:13.572599 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-06df647b-ec3b-4cb0-aac5-eaf0bd3f567d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:13.573057 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-06df647b-ec3b-4cb0-aac5-eaf0bd3f567d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:13.707265 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-06df647b-ec3b-4cb0-aac5-eaf0bd3f567d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:13.716486 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-06df647b-ec3b-4cb0-aac5-eaf0bd3f567d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1738 microversion: 2.1 time: 0.157048 May 26 12:39:13.717099 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 362/737] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:13 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:14.733912 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-8a9992cc-4659-4921-9d93-1fe2a2d1f49c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:14.734513 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-8a9992cc-4659-4921-9d93-1fe2a2d1f49c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:14.743140 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8a9992cc-4659-4921-9d93-1fe2a2d1f49c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:14.743612 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8a9992cc-4659-4921-9d93-1fe2a2d1f49c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:14.744364 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8a9992cc-4659-4921-9d93-1fe2a2d1f49c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:14.744822 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8a9992cc-4659-4921-9d93-1fe2a2d1f49c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:14.893505 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-8a9992cc-4659-4921-9d93-1fe2a2d1f49c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:14.902656 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-8a9992cc-4659-4921-9d93-1fe2a2d1f49c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1718 microversion: 2.1 time: 0.172682 May 26 12:39:14.903333 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 376/738] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:14 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1718 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:14.968934 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b3f71f48-5b83-49b2-8a21-65adad93528b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:14.969499 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b3f71f48-5b83-49b2-8a21-65adad93528b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:14.979158 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b3f71f48-5b83-49b2-8a21-65adad93528b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:14.979966 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b3f71f48-5b83-49b2-8a21-65adad93528b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:14.980917 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b3f71f48-5b83-49b2-8a21-65adad93528b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:14.981742 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b3f71f48-5b83-49b2-8a21-65adad93528b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:15.021502 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:15.153701 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.wsgi [None req-b3f71f48-5b83-49b2-8a21-65adad93528b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] HTTP exception thrown: Cannot 'detach_volume' instance c221b67a-627a-485b-9790-4de1b4c73aa3 while it is in vm_state rescued May 26 12:39:15.158399 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b3f71f48-5b83-49b2-8a21-65adad93528b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Request method failure captured: May 26 12:39:15.158399 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: request: DELETE /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3/os-volume_attachments/650941cf-0d0e-4747-b103-539eda008a74 HTTP/1.1 May 26 12:39:15.158399 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept: application/json May 26 12:39:15.158399 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept-Encoding: identity May 26 12:39:15.158399 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Connection: close May 26 12:39:15.158399 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Length: 0 May 26 12:39:15.158399 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Type: application/json May 26 12:39:15.158399 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Host: 10.222.0.39 May 26 12:39:15.158399 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Openstack-System-Scope: None May 26 12:39:15.158399 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: User-Agent: python-urllib3/1.26.9 May 26 12:39:15.158399 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Auth-Token: gAAAAABij3Ntqo6mdEJ8LlroeinMz0Ovwgkcu2R0zXHjrqQCwq-qJ6oPcC8FCHT3hC1bdixJrdJYoCLHstLf6akw5UN-MphCul9GtSUwf9FwmTUfFUAxs8HgSg_WfADTM9Joom-FI-Cefk6wDfus-Tadb14JEb56PeYzGrxEpIbsZQQAobngoa8 May 26 12:39:15.158399 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Id: None May 26 12:39:15.158399 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Name: None May 26 12:39:15.158399 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Identity-Status: Confirmed May 26 12:39:15.158399 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Is-Admin-Project: True May 26 12:39:15.158399 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Id: default May 26 12:39:15.158399 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Name: Default May 26 12:39:15.158399 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Id: d04d37bf7dfc47f3b20a58a3d95c1c2b May 26 12:39:15.158399 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1556240871 May 26 12:39:15.158399 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Role: member,reader May 26 12:39:15.158399 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Roles: member,reader May 26 12:39:15.160572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d04d37bf7dfc47f3b20a58a3d95c1c2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d04d37bf7dfc47f3b20a58a3d95c1c2b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d04d37bf7dfc47f3b20a58a3d95c1c2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d04d37bf7dfc47f3b20a58a3d95c1c2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:39:15.160572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1556240871 May 26 12:39:15.160572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Id: d04d37bf7dfc47f3b20a58a3d95c1c2b May 26 12:39:15.160572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1556240871 May 26 12:39:15.160572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User: tempest-ServerRescueNegativeTestJSON-1556240871-project May 26 12:39:15.160572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Id: default May 26 12:39:15.160572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Name: Default May 26 12:39:15.160572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Id: c21602eca99d48d8824c0f5c1693d573 May 26 12:39:15.160572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1556240871-project May 26 12:39:15.160572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: method: > May 26 12:39:15.160572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: exception: Cannot 'detach_volume' instance c221b67a-627a-485b-9790-4de1b4c73aa3 while it is in vm_state rescued May 26 12:39:15.161521 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: action_args: {'server_id': 'c221b67a-627a-485b-9790-4de1b4c73aa3', 'id': '650941cf-0d0e-4747-b103-539eda008a74'} May 26 12:39:15.161521 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:39:15.161521 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:39:15.161521 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 12:39:15.161521 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 12:39:15.161521 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 12:39:15.161521 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 12:39:15.161521 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 12:39:15.161521 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 12:39:15.161521 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c221b67a-627a-485b-9790-4de1b4c73aa3 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 26 12:39:15.161521 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:39:15.161521 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:39:15.161521 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:39:15.161521 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:39:15.161521 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:39:15.161521 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:39:15.161521 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:39:15.161521 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:39:15.161521 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:39:15.161521 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:39:15.162900 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 26 12:39:15.162900 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 12:39:15.162900 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 12:39:15.162900 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 12:39:15.162900 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c221b67a-627a-485b-9790-4de1b4c73aa3 while it is in vm_state rescued May 26 12:39:15.162900 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:39:15.162900 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:39:15.162900 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:39:15.162900 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:39:15.162900 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:39:15.162900 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:39:15.162900 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:39:15.162900 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:39:15.162900 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c221b67a-627a-485b-9790-4de1b4c73aa3 while it is in vm_state rescued May 26 12:39:15.162900 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:39:15.162900 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b3f71f48-5b83-49b2-8a21-65adad93528b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Returning 409 to user: Cannot 'detach_volume' instance c221b67a-627a-485b-9790-4de1b4c73aa3 while it is in vm_state rescued {{(pid=124134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:39:15.164039 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b3f71f48-5b83-49b2-8a21-65adad93528b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3/os-volume_attachments/650941cf-0d0e-4747-b103-539eda008a74" status: 409 len: 152 microversion: 2.1 time: 0.195098 May 26 12:39:15.164039 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 363/739] 10.222.0.39 () {58 vars in 1415 bytes} [Thu May 26 12:39:14 2022] DELETE /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3/os-volume_attachments/650941cf-0d0e-4747-b103-539eda008a74 => generated 152 bytes in 196 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 12:39:15.169965 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-de9556d1-24cc-40b2-9b50-41a657ca480f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:15.170490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-de9556d1-24cc-40b2-9b50-41a657ca480f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:15.177261 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-de9556d1-24cc-40b2-9b50-41a657ca480f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:15.177711 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-de9556d1-24cc-40b2-9b50-41a657ca480f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:15.178478 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-de9556d1-24cc-40b2-9b50-41a657ca480f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:15.178915 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-de9556d1-24cc-40b2-9b50-41a657ca480f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:15.268380 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-de9556d1-24cc-40b2-9b50-41a657ca480f tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "POST /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3/action" status: 202 len: 0 microversion: 2.1 time: 0.102235 May 26 12:39:15.269036 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 377/740] 10.222.0.39 () {60 vars in 1277 bytes} [Thu May 26 12:39:15 2022] POST /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 12:39:15.280333 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-52a18c9e-fe70-4a8e-b12f-1c9cc3cb3e49 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:15.280646 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-52a18c9e-fe70-4a8e-b12f-1c9cc3cb3e49 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:15.291656 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-52a18c9e-fe70-4a8e-b12f-1c9cc3cb3e49 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:15.292510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-52a18c9e-fe70-4a8e-b12f-1c9cc3cb3e49 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:15.293436 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-52a18c9e-fe70-4a8e-b12f-1c9cc3cb3e49 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:15.293950 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-52a18c9e-fe70-4a8e-b12f-1c9cc3cb3e49 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:15.553361 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-52a18c9e-fe70-4a8e-b12f-1c9cc3cb3e49 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:15.562962 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-52a18c9e-fe70-4a8e-b12f-1c9cc3cb3e49 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1726 microversion: 2.1 time: 0.289000 May 26 12:39:15.564009 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 364/741] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:15 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1726 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:16.583432 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ebe9f884-6e99-41e4-8afd-4dd99cdb2849 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:16.584123 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ebe9f884-6e99-41e4-8afd-4dd99cdb2849 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:16.590414 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ebe9f884-6e99-41e4-8afd-4dd99cdb2849 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:16.590867 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ebe9f884-6e99-41e4-8afd-4dd99cdb2849 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:16.591646 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ebe9f884-6e99-41e4-8afd-4dd99cdb2849 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:16.592069 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ebe9f884-6e99-41e4-8afd-4dd99cdb2849 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:16.727068 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ebe9f884-6e99-41e4-8afd-4dd99cdb2849 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:16.735301 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ebe9f884-6e99-41e4-8afd-4dd99cdb2849 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1726 microversion: 2.1 time: 0.156624 May 26 12:39:16.735876 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 378/742] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:16 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:17.753063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-27e0f6dd-4174-4283-8da3-7e9930c4a3f2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:17.753650 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-27e0f6dd-4174-4283-8da3-7e9930c4a3f2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:17.764392 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-27e0f6dd-4174-4283-8da3-7e9930c4a3f2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:17.764882 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-27e0f6dd-4174-4283-8da3-7e9930c4a3f2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:17.765674 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-27e0f6dd-4174-4283-8da3-7e9930c4a3f2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:17.766112 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-27e0f6dd-4174-4283-8da3-7e9930c4a3f2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:17.903774 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-27e0f6dd-4174-4283-8da3-7e9930c4a3f2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:17.911783 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-27e0f6dd-4174-4283-8da3-7e9930c4a3f2 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1726 microversion: 2.1 time: 0.162642 May 26 12:39:17.912332 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 365/743] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:17 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:18.929478 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e2259bed-f6ce-46b9-9bfe-5d14f22c2a57 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:18.930285 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e2259bed-f6ce-46b9-9bfe-5d14f22c2a57 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:18.936538 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e2259bed-f6ce-46b9-9bfe-5d14f22c2a57 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:18.937288 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e2259bed-f6ce-46b9-9bfe-5d14f22c2a57 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:18.938050 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e2259bed-f6ce-46b9-9bfe-5d14f22c2a57 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:18.938483 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e2259bed-f6ce-46b9-9bfe-5d14f22c2a57 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:19.066386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e2259bed-f6ce-46b9-9bfe-5d14f22c2a57 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:19.074539 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e2259bed-f6ce-46b9-9bfe-5d14f22c2a57 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1726 microversion: 2.1 time: 0.148925 May 26 12:39:19.075105 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 379/744] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:18 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:20.092363 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-33a1f09f-0c08-41b2-9592-e9d164e0314a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:20.093069 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-33a1f09f-0c08-41b2-9592-e9d164e0314a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:20.099639 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-33a1f09f-0c08-41b2-9592-e9d164e0314a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:20.100093 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-33a1f09f-0c08-41b2-9592-e9d164e0314a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:20.100896 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-33a1f09f-0c08-41b2-9592-e9d164e0314a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:20.101374 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-33a1f09f-0c08-41b2-9592-e9d164e0314a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:20.234525 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-33a1f09f-0c08-41b2-9592-e9d164e0314a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:20.243323 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-33a1f09f-0c08-41b2-9592-e9d164e0314a tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1732 microversion: 2.1 time: 0.154482 May 26 12:39:20.243882 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 366/745] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:20 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:20.260473 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d2a1f953-e429-4142-9463-a7b7c3ae31aa tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:20.261041 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d2a1f953-e429-4142-9463-a7b7c3ae31aa tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:20.267925 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d2a1f953-e429-4142-9463-a7b7c3ae31aa tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:20.268374 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d2a1f953-e429-4142-9463-a7b7c3ae31aa tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:20.269161 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d2a1f953-e429-4142-9463-a7b7c3ae31aa tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:20.269598 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d2a1f953-e429-4142-9463-a7b7c3ae31aa tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:20.349636 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-d2a1f953-e429-4142-9463-a7b7c3ae31aa tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093916 May 26 12:39:20.350207 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 380/746] 10.222.0.39 () {58 vars in 1274 bytes} [Thu May 26 12:39:20 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:39:21.486046 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-f2fe97cd-407e-4396-b022-44ffd3d18b5f req-4bd7c93e-1751-40d4-864a-56bd151ac83f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c221b67a-627a-485b-9790-4de1b4c73aa3", "tag": "ae3caa21-abd3-4200-9c1d-7ce93b0d6e74"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:21.495146 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-f2fe97cd-407e-4396-b022-44ffd3d18b5f req-4bd7c93e-1751-40d4-864a-56bd151ac83f service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:21.495596 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-f2fe97cd-407e-4396-b022-44ffd3d18b5f req-4bd7c93e-1751-40d4-864a-56bd151ac83f service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:21.507046 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-f2fe97cd-407e-4396-b022-44ffd3d18b5f req-4bd7c93e-1751-40d4-864a-56bd151ac83f service nova] Creating event network-changed:ae3caa21-abd3-4200-9c1d-7ce93b0d6e74 for instance c221b67a-627a-485b-9790-4de1b4c73aa3 on hv-cinder-81514 May 26 12:39:21.513211 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-f2fe97cd-407e-4396-b022-44ffd3d18b5f req-4bd7c93e-1751-40d4-864a-56bd151ac83f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093700 May 26 12:39:21.513808 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 367/747] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:39:23.528641 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-26f51c48-bd59-4eca-8ec3-15651fc6c41d req-22ee0577-5497-45a8-97ab-e830a1453d8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c221b67a-627a-485b-9790-4de1b4c73aa3", "tag": "ae3caa21-abd3-4200-9c1d-7ce93b0d6e74"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:23.536571 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-26f51c48-bd59-4eca-8ec3-15651fc6c41d req-22ee0577-5497-45a8-97ab-e830a1453d8c service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:23.537084 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-26f51c48-bd59-4eca-8ec3-15651fc6c41d req-22ee0577-5497-45a8-97ab-e830a1453d8c service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:23.548648 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-26f51c48-bd59-4eca-8ec3-15651fc6c41d req-22ee0577-5497-45a8-97ab-e830a1453d8c service nova] Creating event network-changed:ae3caa21-abd3-4200-9c1d-7ce93b0d6e74 for instance c221b67a-627a-485b-9790-4de1b4c73aa3 on hv-cinder-81514 May 26 12:39:23.553638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-26f51c48-bd59-4eca-8ec3-15651fc6c41d req-22ee0577-5497-45a8-97ab-e830a1453d8c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029080 May 26 12:39:23.554270 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 381/748] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:39:31.492421 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=25 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:31.499881 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=25 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:31.504168 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-83894280-49ae-40d1-8b45-23880382f4ca tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:31.505308 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-83894280-49ae-40d1-8b45-23880382f4ca tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:31.512756 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-83894280-49ae-40d1-8b45-23880382f4ca tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:31.513210 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-83894280-49ae-40d1-8b45-23880382f4ca tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:31.513970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-83894280-49ae-40d1-8b45-23880382f4ca tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:31.514403 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-83894280-49ae-40d1-8b45-23880382f4ca tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:31.540045 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-83894280-49ae-40d1-8b45-23880382f4ca tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f/ips" status: 200 len: 151 microversion: 2.1 time: 0.169803 May 26 12:39:31.540574 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 368/749] 10.222.0.39 () {58 vars in 1247 bytes} [Thu May 26 12:39:31 2022] GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f/ips => generated 151 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:39:31.551714 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-74f351fc-df6c-4166-b5cd-8e60a38e05ce tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0496d04-3662-4a04-a751-0c45fcec95d7"}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:31.552924 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-74f351fc-df6c-4166-b5cd-8e60a38e05ce tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:31.556260 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=28 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:31.561961 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-74f351fc-df6c-4166-b5cd-8e60a38e05ce tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:31.562424 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-74f351fc-df6c-4166-b5cd-8e60a38e05ce tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:31.563200 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-74f351fc-df6c-4166-b5cd-8e60a38e05ce tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:31.563643 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-74f351fc-df6c-4166-b5cd-8e60a38e05ce tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:31.567492 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:31.654457 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-74f351fc-df6c-4166-b5cd-8e60a38e05ce tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] HTTP exception thrown: Invalid volume: volume f0496d04-3662-4a04-a751-0c45fcec95d7 is already attached to instances: 1cfc21dd-efee-45cb-9462-cdd0025a5038 May 26 12:39:31.656199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-74f351fc-df6c-4166-b5cd-8e60a38e05ce tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Request method failure captured: May 26 12:39:31.656199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: POST /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f/os-volume_attachments HTTP/1.1 May 26 12:39:31.656199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:39:31.656199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:39:31.656199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:39:31.656199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 74 May 26 12:39:31.656199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:39:31.656199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:39:31.656199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:39:31.656199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:39:31.656199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3NlvcGUyXKMcR3f44eTcb9KUX9Z1HAOP6nfmLvSlYo0JIjkhlxQnvnKs5YzuXlFyVI90MMwVyxF6G0XRw3coPQTRjw_l752cMl_otjGJnnaQ4RjUOg-dE0XHNrSgowu0nH-j9SReMVUJ7YwVfxzPS5nbVTF1HJ2aVri9hxI7XdrhVs May 26 12:39:31.656199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:39:31.656199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:39:31.656199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:39:31.656199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:39:31.656199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:39:31.656199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:39:31.656199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:39:31.656199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:39:31.656199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:39:31.656199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:39:31.657820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7ef656c0ca2943eb965bf10d4e943d27", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:39:31.657820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:39:31.657820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:39:31.657820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:39:31.657820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:39:31.657820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:39:31.657820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:39:31.657820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: 7b14606965a74c71881595c71bdd2d58 May 26 12:39:31.657820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:39:31.657820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: May 26 12:39:31.657820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {"volumeAttachment": {"volumeId": "f0496d04-3662-4a04-a751-0c45fcec95d7"}} May 26 12:39:31.657820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: > May 26 12:39:31.658776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Invalid volume: volume f0496d04-3662-4a04-a751-0c45fcec95d7 is already attached to instances: 1cfc21dd-efee-45cb-9462-cdd0025a5038 May 26 12:39:31.658776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'server_id': '877c410c-52d3-4dcb-b248-61708093ac8f', 'body': {'volumeAttachment': {'volumeId': 'f0496d04-3662-4a04-a751-0c45fcec95d7'}}} May 26 12:39:31.658776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:39:31.658776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:39:31.658776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 12:39:31.658776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 12:39:31.658776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 12:39:31.658776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 12:39:31.658776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 12:39:31.658776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 12:39:31.658776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 12:39:31.658776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 12:39:31.658776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 12:39:31.658776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 12:39:31.658776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f0496d04-3662-4a04-a751-0c45fcec95d7 is already attached to instances: 1cfc21dd-efee-45cb-9462-cdd0025a5038 May 26 12:39:31.658776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:39:31.658776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:39:31.658776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:39:31.658776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:39:31.660197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:39:31.660197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:39:31.660197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:39:31.660197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:39:31.660197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:39:31.660197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:39:31.660197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:39:31.660197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:39:31.660197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:39:31.660197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:39:31.660197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:39:31.660197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:39:31.660197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 12:39:31.660197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 12:39:31.660197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f0496d04-3662-4a04-a751-0c45fcec95d7 is already attached to instances: 1cfc21dd-efee-45cb-9462-cdd0025a5038 May 26 12:39:31.660197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:39:31.660197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:39:31.660197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:39:31.660197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:39:31.660197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:39:31.661667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:39:31.661667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:39:31.661667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:39:31.661667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f0496d04-3662-4a04-a751-0c45fcec95d7 is already attached to instances: 1cfc21dd-efee-45cb-9462-cdd0025a5038 May 26 12:39:31.661667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:39:31.661667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-74f351fc-df6c-4166-b5cd-8e60a38e05ce tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Returning 400 to user: Invalid volume: volume f0496d04-3662-4a04-a751-0c45fcec95d7 is already attached to instances: 1cfc21dd-efee-45cb-9462-cdd0025a5038 {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:39:31.661667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-74f351fc-df6c-4166-b5cd-8e60a38e05ce tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "POST /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110510 May 26 12:39:31.661667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 382/750] 10.222.0.39 () {60 vars in 1322 bytes} [Thu May 26 12:39:31 2022] POST /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 12:39:31.667138 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-256e137b-4c19-4800-a734-07069fcab41c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:31.667627 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-256e137b-4c19-4800-a734-07069fcab41c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:31.673665 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-256e137b-4c19-4800-a734-07069fcab41c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:31.674114 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-256e137b-4c19-4800-a734-07069fcab41c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:31.674871 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-256e137b-4c19-4800-a734-07069fcab41c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:31.675313 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-256e137b-4c19-4800-a734-07069fcab41c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:31.704575 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-256e137b-4c19-4800-a734-07069fcab41c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] Going to try to terminate instance {{(pid=124134) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:39:31.809146 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-256e137b-4c19-4800-a734-07069fcab41c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "DELETE /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f" status: 204 len: 0 microversion: 2.1 time: 0.145799 May 26 12:39:31.809987 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 369/751] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:39:31 2022] DELETE /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:39:31.819052 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e2501397-49cc-4b70-b77f-2e4d1af395ef tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:31.820146 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e2501397-49cc-4b70-b77f-2e4d1af395ef tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:31.826569 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e2501397-49cc-4b70-b77f-2e4d1af395ef tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:31.827009 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e2501397-49cc-4b70-b77f-2e4d1af395ef tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:31.827771 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e2501397-49cc-4b70-b77f-2e4d1af395ef tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:31.828208 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e2501397-49cc-4b70-b77f-2e4d1af395ef tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:31.979911 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e2501397-49cc-4b70-b77f-2e4d1af395ef tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:31.987959 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e2501397-49cc-4b70-b77f-2e4d1af395ef tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f" status: 200 len: 1683 microversion: 2.1 time: 0.172686 May 26 12:39:31.988531 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 383/752] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:31 2022] GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:33.008374 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-70638743-15d5-47dc-a1a9-291fda20a9b6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:33.008998 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-70638743-15d5-47dc-a1a9-291fda20a9b6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:33.016818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-70638743-15d5-47dc-a1a9-291fda20a9b6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:33.017276 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-70638743-15d5-47dc-a1a9-291fda20a9b6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:33.018058 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-70638743-15d5-47dc-a1a9-291fda20a9b6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:33.018502 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-70638743-15d5-47dc-a1a9-291fda20a9b6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:33.154204 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-70638743-15d5-47dc-a1a9-291fda20a9b6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:33.162235 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-70638743-15d5-47dc-a1a9-291fda20a9b6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f" status: 200 len: 1683 microversion: 2.1 time: 0.158886 May 26 12:39:33.162800 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 370/753] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:33 2022] GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:34.181776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-c1ad24d3-d3ff-40e8-950c-d9cb2359c462 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:34.182413 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-c1ad24d3-d3ff-40e8-950c-d9cb2359c462 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:34.189425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c1ad24d3-d3ff-40e8-950c-d9cb2359c462 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:34.189923 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c1ad24d3-d3ff-40e8-950c-d9cb2359c462 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:34.190793 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c1ad24d3-d3ff-40e8-950c-d9cb2359c462 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:34.191229 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c1ad24d3-d3ff-40e8-950c-d9cb2359c462 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:34.407375 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-c1ad24d3-d3ff-40e8-950c-d9cb2359c462 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:34.415862 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-c1ad24d3-d3ff-40e8-950c-d9cb2359c462 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f" status: 200 len: 1683 microversion: 2.1 time: 0.239073 May 26 12:39:34.416438 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 384/754] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:34 2022] GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f => generated 1683 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:35.319699 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-49d4fc09-4e6e-4506-9aae-b879c21b5d0e req-4293cc3c-77f5-45e9-8790-c6edb04c1667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "877c410c-52d3-4dcb-b248-61708093ac8f", "name": "network-vif-deleted", "tag": "b7d790b4-17d2-4600-ae11-9a7bdeca8da6"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:35.329598 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-49d4fc09-4e6e-4506-9aae-b879c21b5d0e req-4293cc3c-77f5-45e9-8790-c6edb04c1667 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:35.330142 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-49d4fc09-4e6e-4506-9aae-b879c21b5d0e req-4293cc3c-77f5-45e9-8790-c6edb04c1667 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:35.342609 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-49d4fc09-4e6e-4506-9aae-b879c21b5d0e req-4293cc3c-77f5-45e9-8790-c6edb04c1667 service nova] Creating event network-vif-deleted:b7d790b4-17d2-4600-ae11-9a7bdeca8da6 for instance 877c410c-52d3-4dcb-b248-61708093ac8f on hv-cinder-81514 May 26 12:39:35.347798 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-49d4fc09-4e6e-4506-9aae-b879c21b5d0e req-4293cc3c-77f5-45e9-8790-c6edb04c1667 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112309 May 26 12:39:35.348663 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 371/755] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:39:35.434920 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ae102213-fa22-41e3-914a-d6862473bcc6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:35.435664 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ae102213-fa22-41e3-914a-d6862473bcc6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:35.442864 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ae102213-fa22-41e3-914a-d6862473bcc6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:35.443508 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ae102213-fa22-41e3-914a-d6862473bcc6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:35.444509 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ae102213-fa22-41e3-914a-d6862473bcc6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:35.445839 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ae102213-fa22-41e3-914a-d6862473bcc6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:35.482124 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ae102213-fa22-41e3-914a-d6862473bcc6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:35.482592 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ae102213-fa22-41e3-914a-d6862473bcc6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:35.483125 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.objects.instance [None req-ae102213-fa22-41e3-914a-d6862473bcc6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lazy-loading 'fault' on Instance uuid 877c410c-52d3-4dcb-b248-61708093ac8f {{(pid=124133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:39:35.530770 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ae102213-fa22-41e3-914a-d6862473bcc6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:35.539433 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ae102213-fa22-41e3-914a-d6862473bcc6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f" status: 200 len: 1331 microversion: 2.1 time: 0.108419 May 26 12:39:35.540015 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 385/756] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:35 2022] GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:36.557947 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f791fbab-6499-4ee7-a4eb-bc02b37add29 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:36.558554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-f791fbab-6499-4ee7-a4eb-bc02b37add29 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:36.565004 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f791fbab-6499-4ee7-a4eb-bc02b37add29 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:36.565457 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f791fbab-6499-4ee7-a4eb-bc02b37add29 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:36.566226 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f791fbab-6499-4ee7-a4eb-bc02b37add29 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:36.566658 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f791fbab-6499-4ee7-a4eb-bc02b37add29 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:36.581908 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.wsgi [None req-f791fbab-6499-4ee7-a4eb-bc02b37add29 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] HTTP exception thrown: Instance 877c410c-52d3-4dcb-b248-61708093ac8f could not be found. May 26 12:39:36.584206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f791fbab-6499-4ee7-a4eb-bc02b37add29 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Request method failure captured: May 26 12:39:36.584206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: request: GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f HTTP/1.1 May 26 12:39:36.584206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept: application/json May 26 12:39:36.584206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept-Encoding: identity May 26 12:39:36.584206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Connection: close May 26 12:39:36.584206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Length: 0 May 26 12:39:36.584206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Type: application/json May 26 12:39:36.584206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Host: 10.222.0.39 May 26 12:39:36.584206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Openstack-System-Scope: None May 26 12:39:36.584206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: User-Agent: python-urllib3/1.26.9 May 26 12:39:36.584206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Auth-Token: gAAAAABij3NlvcGUyXKMcR3f44eTcb9KUX9Z1HAOP6nfmLvSlYo0JIjkhlxQnvnKs5YzuXlFyVI90MMwVyxF6G0XRw3coPQTRjw_l752cMl_otjGJnnaQ4RjUOg-dE0XHNrSgowu0nH-j9SReMVUJ7YwVfxzPS5nbVTF1HJ2aVri9hxI7XdrhVs May 26 12:39:36.584206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Id: None May 26 12:39:36.584206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Name: None May 26 12:39:36.584206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Identity-Status: Confirmed May 26 12:39:36.584206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Is-Admin-Project: True May 26 12:39:36.584206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Id: default May 26 12:39:36.584206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Name: Default May 26 12:39:36.584206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:39:36.584206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:39:36.584206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Role: member,reader May 26 12:39:36.584206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Roles: member,reader May 26 12:39:36.586289 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7ef656c0ca2943eb965bf10d4e943d27", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:39:36.586289 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:39:36.586289 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:39:36.586289 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:39:36.586289 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:39:36.586289 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Id: default May 26 12:39:36.586289 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Name: Default May 26 12:39:36.586289 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Id: 7b14606965a74c71881595c71bdd2d58 May 26 12:39:36.586289 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Name: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:39:36.586289 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: method: > May 26 12:39:36.586289 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: exception: Instance 877c410c-52d3-4dcb-b248-61708093ac8f could not be found. May 26 12:39:36.586289 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: action_args: {'id': '877c410c-52d3-4dcb-b248-61708093ac8f'} May 26 12:39:36.587202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:39:36.587202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:39:36.587202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:39:36.587202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:39:36.587202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:39:36.587202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:39:36.587202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:39:36.587202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:39:36.587202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:39:36.587202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:39:36.587202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 877c410c-52d3-4dcb-b248-61708093ac8f could not be found. May 26 12:39:36.587202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:39:36.587202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:39:36.587202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:39:36.587202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:39:36.587202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:39:36.587202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:39:36.587202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:39:36.587202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:39:36.587202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:39:36.588743 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:39:36.588743 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:39:36.588743 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:39:36.588743 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:39:36.588743 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:39:36.588743 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:39:36.588743 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:39:36.588743 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 877c410c-52d3-4dcb-b248-61708093ac8f could not be found. May 26 12:39:36.588743 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:39:36.588743 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:39:36.588743 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:39:36.588743 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:39:36.588743 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:39:36.588743 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:39:36.588743 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:39:36.588743 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:39:36.588743 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 877c410c-52d3-4dcb-b248-61708093ac8f could not be found. May 26 12:39:36.588743 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:39:36.590065 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f791fbab-6499-4ee7-a4eb-bc02b37add29 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Returning 404 to user: Instance 877c410c-52d3-4dcb-b248-61708093ac8f could not be found. {{(pid=124134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:39:36.590065 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-f791fbab-6499-4ee7-a4eb-bc02b37add29 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f" status: 404 len: 111 microversion: 2.1 time: 0.032837 May 26 12:39:36.590065 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 372/757] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:36 2022] GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:39:36.599085 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-4357d5c6-4895-46d3-9c5d-f0f074b38c6b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '.version_select at 0x7fed3148e8b0>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:36.619595 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-4357d5c6-4895-46d3-9c5d-f0f074b38c6b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-950477501" status: 202 len: 0 microversion: 2.1 time: 0.024372 May 26 12:39:36.620178 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 386/758] 10.222.0.39 () {58 vars in 1217 bytes} [Thu May 26 12:39:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-950477501 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:39:37.405906 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-a7a43c27-cfe7-4f01-a68a-246cf739f131 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:37.406402 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-a7a43c27-cfe7-4f01-a68a-246cf739f131 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:37.413738 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a7a43c27-cfe7-4f01-a68a-246cf739f131 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:37.414384 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a7a43c27-cfe7-4f01-a68a-246cf739f131 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:37.415175 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a7a43c27-cfe7-4f01-a68a-246cf739f131 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:37.415605 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a7a43c27-cfe7-4f01-a68a-246cf739f131 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:37.503533 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.objects.instance [None req-a7a43c27-cfe7-4f01-a68a-246cf739f131 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lazy-loading 'services' on Instance uuid 1cfc21dd-efee-45cb-9462-cdd0025a5038 {{(pid=124134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:39:37.629571 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-a7a43c27-cfe7-4f01-a68a-246cf739f131 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038/os-volume_attachments/f0496d04-3662-4a04-a751-0c45fcec95d7" status: 202 len: 0 microversion: 2.1 time: 0.227580 May 26 12:39:37.630503 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 373/759] 10.222.0.39 () {58 vars in 1415 bytes} [Thu May 26 12:39:37 2022] DELETE /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038/os-volume_attachments/f0496d04-3662-4a04-a751-0c45fcec95d7 => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:39:37.639390 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-9caa47f4-e230-4b1a-b8ee-8cb40e3e04e4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:37.640317 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-9caa47f4-e230-4b1a-b8ee-8cb40e3e04e4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:37.647379 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9caa47f4-e230-4b1a-b8ee-8cb40e3e04e4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:37.648417 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9caa47f4-e230-4b1a-b8ee-8cb40e3e04e4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:37.649286 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9caa47f4-e230-4b1a-b8ee-8cb40e3e04e4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:37.649913 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9caa47f4-e230-4b1a-b8ee-8cb40e3e04e4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:37.680349 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-9caa47f4-e230-4b1a-b8ee-8cb40e3e04e4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045664 May 26 12:39:37.684409 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 387/760] 10.222.0.39 () {58 vars in 1301 bytes} [Thu May 26 12:39:37 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:39:38.692850 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-d7bd98d6-a582-458b-8dc6-b9e4f230f0d2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:38.693908 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-d7bd98d6-a582-458b-8dc6-b9e4f230f0d2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:38.700950 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d7bd98d6-a582-458b-8dc6-b9e4f230f0d2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:38.701406 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d7bd98d6-a582-458b-8dc6-b9e4f230f0d2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:38.702172 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d7bd98d6-a582-458b-8dc6-b9e4f230f0d2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:38.702614 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d7bd98d6-a582-458b-8dc6-b9e4f230f0d2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:38.733331 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-d7bd98d6-a582-458b-8dc6-b9e4f230f0d2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045226 May 26 12:39:38.733889 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 374/761] 10.222.0.39 () {58 vars in 1301 bytes} [Thu May 26 12:39:38 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:39:39.745745 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-39e1d825-493b-4387-a21a-e2de3f8eceb1 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:39.746676 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-39e1d825-493b-4387-a21a-e2de3f8eceb1 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:39.753285 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-39e1d825-493b-4387-a21a-e2de3f8eceb1 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:39.753743 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-39e1d825-493b-4387-a21a-e2de3f8eceb1 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:39.754523 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-39e1d825-493b-4387-a21a-e2de3f8eceb1 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:39.754975 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-39e1d825-493b-4387-a21a-e2de3f8eceb1 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:39.784384 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-39e1d825-493b-4387-a21a-e2de3f8eceb1 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043327 May 26 12:39:39.784976 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 388/762] 10.222.0.39 () {58 vars in 1301 bytes} [Thu May 26 12:39:39 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:39:39.845343 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-c5418326-1906-4a3c-870d-26fa0179b7e6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:39.845916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-c5418326-1906-4a3c-870d-26fa0179b7e6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:39.853158 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c5418326-1906-4a3c-870d-26fa0179b7e6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:39.853610 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c5418326-1906-4a3c-870d-26fa0179b7e6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:39.854374 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c5418326-1906-4a3c-870d-26fa0179b7e6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:39.854813 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c5418326-1906-4a3c-870d-26fa0179b7e6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:39.880034 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-c5418326-1906-4a3c-870d-26fa0179b7e6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Going to try to terminate instance {{(pid=124134) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:39:39.959801 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-c5418326-1906-4a3c-870d-26fa0179b7e6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 204 len: 0 microversion: 2.1 time: 0.117975 May 26 12:39:39.961572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 375/763] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:39:39 2022] DELETE /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:39:39.969872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e8286a4b-53b7-4c88-b6f4-b6215147bec6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:39.970483 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e8286a4b-53b7-4c88-b6f4-b6215147bec6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:39.977345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e8286a4b-53b7-4c88-b6f4-b6215147bec6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:39.977793 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e8286a4b-53b7-4c88-b6f4-b6215147bec6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:39.978555 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e8286a4b-53b7-4c88-b6f4-b6215147bec6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:39.979000 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e8286a4b-53b7-4c88-b6f4-b6215147bec6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:40.114078 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e8286a4b-53b7-4c88-b6f4-b6215147bec6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:40.121709 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e8286a4b-53b7-4c88-b6f4-b6215147bec6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1680 microversion: 2.1 time: 0.155730 May 26 12:39:40.122267 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 389/764] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:39 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:41.140359 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-0079e9b9-4eb7-47e4-b852-d58b47f3b049 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:41.140998 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-0079e9b9-4eb7-47e4-b852-d58b47f3b049 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:41.147434 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0079e9b9-4eb7-47e4-b852-d58b47f3b049 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:41.148626 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0079e9b9-4eb7-47e4-b852-d58b47f3b049 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:41.149544 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0079e9b9-4eb7-47e4-b852-d58b47f3b049 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:41.149980 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0079e9b9-4eb7-47e4-b852-d58b47f3b049 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:41.509920 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-0079e9b9-4eb7-47e4-b852-d58b47f3b049 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:41.517794 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-0079e9b9-4eb7-47e4-b852-d58b47f3b049 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1680 microversion: 2.1 time: 0.381993 May 26 12:39:41.518361 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 376/765] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:41 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1680 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:42.517590 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-728c4536-9076-4693-b84e-e770ac64772f req-81d658d6-a69c-4c43-b703-d846e754a5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cfc21dd-efee-45cb-9462-cdd0025a5038", "name": "network-vif-deleted", "tag": "c4a31d7d-0831-4fea-a609-85371a2084a6"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:42.528238 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-728c4536-9076-4693-b84e-e770ac64772f req-81d658d6-a69c-4c43-b703-d846e754a5b7 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:42.528810 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-728c4536-9076-4693-b84e-e770ac64772f req-81d658d6-a69c-4c43-b703-d846e754a5b7 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:42.535867 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e4db7d62-92f3-424c-974e-18d5f0b5a7fc tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:42.536468 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-e4db7d62-92f3-424c-974e-18d5f0b5a7fc tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:42.541536 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-728c4536-9076-4693-b84e-e770ac64772f req-81d658d6-a69c-4c43-b703-d846e754a5b7 service nova] Creating event network-vif-deleted:c4a31d7d-0831-4fea-a609-85371a2084a6 for instance 1cfc21dd-efee-45cb-9462-cdd0025a5038 on hv-cinder-81514 May 26 12:39:42.545913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e4db7d62-92f3-424c-974e-18d5f0b5a7fc tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:42.546596 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e4db7d62-92f3-424c-974e-18d5f0b5a7fc tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:42.547013 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-728c4536-9076-4693-b84e-e770ac64772f req-81d658d6-a69c-4c43-b703-d846e754a5b7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033046 May 26 12:39:42.547702 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 390/766] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:39:42.548077 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e4db7d62-92f3-424c-974e-18d5f0b5a7fc tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:42.548977 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e4db7d62-92f3-424c-974e-18d5f0b5a7fc tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:42.622752 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-e4db7d62-92f3-424c-974e-18d5f0b5a7fc tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:42.631325 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-e4db7d62-92f3-424c-974e-18d5f0b5a7fc tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 200 len: 1325 microversion: 2.1 time: 0.099766 May 26 12:39:42.633296 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 377/767] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:42 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 1325 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:39:43.653307 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-16c27de4-eaaf-4e60-8a6f-ecc4c5807458 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:43.654005 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-16c27de4-eaaf-4e60-8a6f-ecc4c5807458 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:43.660278 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-16c27de4-eaaf-4e60-8a6f-ecc4c5807458 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:43.660740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-16c27de4-eaaf-4e60-8a6f-ecc4c5807458 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:43.661547 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-16c27de4-eaaf-4e60-8a6f-ecc4c5807458 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:43.662001 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-16c27de4-eaaf-4e60-8a6f-ecc4c5807458 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:43.676172 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-16c27de4-eaaf-4e60-8a6f-ecc4c5807458 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] HTTP exception thrown: Instance 1cfc21dd-efee-45cb-9462-cdd0025a5038 could not be found. May 26 12:39:43.677848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-16c27de4-eaaf-4e60-8a6f-ecc4c5807458 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Request method failure captured: May 26 12:39:43.677848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 HTTP/1.1 May 26 12:39:43.677848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:39:43.677848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:39:43.677848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:39:43.677848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:39:43.677848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:39:43.677848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:39:43.677848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:39:43.677848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:39:43.677848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3NlvcGUyXKMcR3f44eTcb9KUX9Z1HAOP6nfmLvSlYo0JIjkhlxQnvnKs5YzuXlFyVI90MMwVyxF6G0XRw3coPQTRjw_l752cMl_otjGJnnaQ4RjUOg-dE0XHNrSgowu0nH-j9SReMVUJ7YwVfxzPS5nbVTF1HJ2aVri9hxI7XdrhVs May 26 12:39:43.677848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:39:43.677848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:39:43.677848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:39:43.677848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:39:43.677848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:39:43.677848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:39:43.677848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:39:43.677848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:39:43.677848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:39:43.677848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:39:43.679567 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7ef656c0ca2943eb965bf10d4e943d27", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:39:43.679567 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:39:43.679567 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:39:43.679567 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:39:43.679567 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:39:43.679567 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:39:43.679567 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:39:43.679567 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: 7b14606965a74c71881595c71bdd2d58 May 26 12:39:43.679567 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:39:43.679567 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: > May 26 12:39:43.679567 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Instance 1cfc21dd-efee-45cb-9462-cdd0025a5038 could not be found. May 26 12:39:43.679567 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': '1cfc21dd-efee-45cb-9462-cdd0025a5038'} May 26 12:39:43.681113 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:39:43.681113 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:39:43.681113 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:39:43.681113 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:39:43.681113 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:39:43.681113 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:39:43.681113 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:39:43.681113 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:39:43.681113 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:39:43.681113 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:39:43.681113 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cfc21dd-efee-45cb-9462-cdd0025a5038 could not be found. May 26 12:39:43.681113 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:39:43.681113 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:39:43.681113 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:39:43.681113 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:39:43.681113 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:39:43.681113 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:39:43.681113 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:39:43.681113 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:39:43.681113 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:39:43.682617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:39:43.682617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:39:43.682617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:39:43.682617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:39:43.682617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:39:43.682617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:39:43.682617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:39:43.682617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cfc21dd-efee-45cb-9462-cdd0025a5038 could not be found. May 26 12:39:43.682617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:39:43.682617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:39:43.682617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:39:43.682617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:39:43.682617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:39:43.682617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:39:43.682617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:39:43.682617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:39:43.682617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cfc21dd-efee-45cb-9462-cdd0025a5038 could not be found. May 26 12:39:43.682617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:39:43.684981 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-16c27de4-eaaf-4e60-8a6f-ecc4c5807458 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Returning 404 to user: Instance 1cfc21dd-efee-45cb-9462-cdd0025a5038 could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:39:43.684981 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-16c27de4-eaaf-4e60-8a6f-ecc4c5807458 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 404 len: 111 microversion: 2.1 time: 0.031404 May 26 12:39:43.684981 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 391/768] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:43 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:39:43.688021 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-244049fd-81ab-42dc-8a5e-1ff49787756c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '.version_select at 0x7fed31470310>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:43.691757 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR oslo.messaging._drivers.impl_rabbit [None req-244049fd-81ab-42dc-8a5e-1ff49787756c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [54ecf005-a39f-4908-9b53-c66e4b203d26] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 12:39:44.700092 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO oslo.messaging._drivers.impl_rabbit [None req-244049fd-81ab-42dc-8a5e-1ff49787756c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [54ecf005-a39f-4908-9b53-c66e4b203d26] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 58198. May 26 12:39:44.719806 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-244049fd-81ab-42dc-8a5e-1ff49787756c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-834799304" status: 202 len: 0 microversion: 2.1 time: 1.035516 May 26 12:39:44.720397 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 378/769] 10.222.0.39 () {58 vars in 1217 bytes} [Thu May 26 12:39:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-834799304 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:39:45.346627 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-5ef44593-a03c-4d6e-8223-9515316eeea2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Action: 'create', calling method: .version_select at 0x7fed314b6b80>, body: {"keypair": {"name": "tempest-keypair-538801290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPL60VpMLZ5aZDCl8lyaRVC/r3d4pOtuZnaHXZJTyXp+64X+RzhyYF8O2wBpCEbA2IRzRapSyCbx1EVBuH5BGTYk2dGzo+lzWKNUyZoik8ZjnKb1a5+SiUyLh1dBGF01LA=="}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:45.360548 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-5ef44593-a03c-4d6e-8223-9515316eeea2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Getting quotas for project 7ef656c0ca2943eb965bf10d4e943d27. Resources: {'key_pairs'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:39:45.364330 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-5ef44593-a03c-4d6e-8223-9515316eeea2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Getting quotas for user 7b14606965a74c71881595c71bdd2d58 and project 7ef656c0ca2943eb965bf10d4e943d27. Resources: {'key_pairs'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:39:45.386613 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-5ef44593-a03c-4d6e-8223-9515316eeea2 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043869 May 26 12:39:45.387188 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 392/770] 10.222.0.39 () {60 vars in 1158 bytes} [Thu May 26 12:39:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:39:46.636063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-a3979d74-8b94-4683-a433-bfac23f3d8f4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2067114413", "imageRef": "7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b932a260-099c-4abe-98f7-c68e5fa9337e"}], "security_groups": [{"name": "tempest-securitygroup--152849479"}], "key_name": "tempest-keypair-538801290", "user_data": "}} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:46.740227 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.network.neutron [None req-a3979d74-8b94-4683-a433-bfac23f3d8f4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] validate_networks() for [('b932a260-099c-4abe-98f7-c68e5fa9337e', None, None, None, None, None)] {{(pid=124134) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:39:47.138031 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-a3979d74-8b94-4683-a433-bfac23f3d8f4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Flavor limits 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:39:47.138510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-a3979d74-8b94-4683-a433-bfac23f3d8f4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Image limits 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:39:47.139075 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-a3979d74-8b94-4683-a433-bfac23f3d8f4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Flavor pref 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:39:47.139419 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-a3979d74-8b94-4683-a433-bfac23f3d8f4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Image pref 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:39:47.140012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-a3979d74-8b94-4683-a433-bfac23f3d8f4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:39:47.152422 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a3979d74-8b94-4683-a433-bfac23f3d8f4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:47.152934 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a3979d74-8b94-4683-a433-bfac23f3d8f4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:47.153745 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a3979d74-8b94-4683-a433-bfac23f3d8f4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:47.154191 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a3979d74-8b94-4683-a433-bfac23f3d8f4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:47.171267 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.quota [None req-a3979d74-8b94-4683-a433-bfac23f3d8f4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Getting quotas for project 7ef656c0ca2943eb965bf10d4e943d27. Resources: {'cores', 'instances', 'ram'} {{(pid=124134) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:39:47.175244 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.quota [None req-a3979d74-8b94-4683-a433-bfac23f3d8f4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Getting quotas for user 7b14606965a74c71881595c71bdd2d58 and project 7ef656c0ca2943eb965bf10d4e943d27. Resources: {'cores', 'instances', 'ram'} {{(pid=124134) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:39:47.186413 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-a3979d74-8b94-4683-a433-bfac23f3d8f4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Going to run 1 instances... {{(pid=124134) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:39:47.188703 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-a3979d74-8b94-4683-a433-bfac23f3d8f4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:39:47.234667 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-a3979d74-8b94-4683-a433-bfac23f3d8f4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.604331 May 26 12:39:47.235307 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 379/771] 10.222.0.39 () {60 vars in 1146 bytes} [Thu May 26 12:39:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:39:47.245159 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-113b40b7-c1c9-45ea-9d14-3815b1466dcd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:47.245774 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-113b40b7-c1c9-45ea-9d14-3815b1466dcd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:47.301130 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-113b40b7-c1c9-45ea-9d14-3815b1466dcd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:47.309230 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-113b40b7-c1c9-45ea-9d14-3815b1466dcd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f" status: 200 len: 1241 microversion: 2.1 time: 0.067918 May 26 12:39:47.309780 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 393/772] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:47 2022] GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:48.171244 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6cc83761-0668-4cd5-94c1-699822349c33 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:48.171841 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-6cc83761-0668-4cd5-94c1-699822349c33 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:48.179398 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6cc83761-0668-4cd5-94c1-699822349c33 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:48.180130 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6cc83761-0668-4cd5-94c1-699822349c33 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:48.181183 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6cc83761-0668-4cd5-94c1-699822349c33 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:48.181654 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6cc83761-0668-4cd5-94c1-699822349c33 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:48.213959 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-6cc83761-0668-4cd5-94c1-699822349c33 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c/os-volume_attachments/90a99a49-9f37-4024-8dcd-62d122232650" status: 200 len: 194 microversion: 2.20 time: 0.047274 May 26 12:39:48.214740 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 380/773] 10.222.0.39 () {60 vars in 1453 bytes} [Thu May 26 12:39:48 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c/os-volume_attachments/90a99a49-9f37-4024-8dcd-62d122232650 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:39:48.289664 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-0ae8c8ab-e492-41f6-ad45-499553f36c95 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:48.290177 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-0ae8c8ab-e492-41f6-ad45-499553f36c95 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:48.298683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0ae8c8ab-e492-41f6-ad45-499553f36c95 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:48.299702 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0ae8c8ab-e492-41f6-ad45-499553f36c95 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:48.300893 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0ae8c8ab-e492-41f6-ad45-499553f36c95 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:48.301511 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0ae8c8ab-e492-41f6-ad45-499553f36c95 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:48.327001 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-46ba7415-587e-4bda-8d9a-a5e7f5d63e76 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:48.327999 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-46ba7415-587e-4bda-8d9a-a5e7f5d63e76 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:48.334375 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-46ba7415-587e-4bda-8d9a-a5e7f5d63e76 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:48.335022 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-46ba7415-587e-4bda-8d9a-a5e7f5d63e76 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:48.336417 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-46ba7415-587e-4bda-8d9a-a5e7f5d63e76 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:48.337078 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-46ba7415-587e-4bda-8d9a-a5e7f5d63e76 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:48.438664 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-46ba7415-587e-4bda-8d9a-a5e7f5d63e76 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:48.448791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-46ba7415-587e-4bda-8d9a-a5e7f5d63e76 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f" status: 200 len: 1311 microversion: 2.1 time: 0.125730 May 26 12:39:48.449676 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 381/774] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:48 2022] GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f => generated 1311 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:48.478212 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.objects.instance [None req-0ae8c8ab-e492-41f6-ad45-499553f36c95 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lazy-loading 'services' on Instance uuid 7af16d0b-59c7-43ea-856c-ec79029b680c {{(pid=124133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:39:48.593298 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-0ae8c8ab-e492-41f6-ad45-499553f36c95 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c/os-volume_attachments/90a99a49-9f37-4024-8dcd-62d122232650" status: 202 len: 0 microversion: 2.20 time: 0.308848 May 26 12:39:48.594062 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 394/775] 10.222.0.39 () {60 vars in 1456 bytes} [Thu May 26 12:39:48 2022] DELETE /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c/os-volume_attachments/90a99a49-9f37-4024-8dcd-62d122232650 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 12:39:48.603788 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-a8b9f805-4750-4e93-b804-dfb0e3b2e693 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:48.605189 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-a8b9f805-4750-4e93-b804-dfb0e3b2e693 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:48.611465 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a8b9f805-4750-4e93-b804-dfb0e3b2e693 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:48.612074 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a8b9f805-4750-4e93-b804-dfb0e3b2e693 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:48.612974 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a8b9f805-4750-4e93-b804-dfb0e3b2e693 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:48.613509 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a8b9f805-4750-4e93-b804-dfb0e3b2e693 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:48.646710 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-a8b9f805-4750-4e93-b804-dfb0e3b2e693 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048377 May 26 12:39:48.647266 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 382/776] 10.222.0.39 () {60 vars in 1342 bytes} [Thu May 26 12:39:48 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:39:49.470712 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-482e878c-f549-4f3e-9c4b-30db26b91554 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:49.471411 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-482e878c-f549-4f3e-9c4b-30db26b91554 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:49.478679 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-482e878c-f549-4f3e-9c4b-30db26b91554 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:49.479139 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-482e878c-f549-4f3e-9c4b-30db26b91554 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:49.479922 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-482e878c-f549-4f3e-9c4b-30db26b91554 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:49.480366 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-482e878c-f549-4f3e-9c4b-30db26b91554 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:49.659793 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-78b5265e-a195-4540-86c5-5d1787e71f60 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:49.661015 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-78b5265e-a195-4540-86c5-5d1787e71f60 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:49.668372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-78b5265e-a195-4540-86c5-5d1787e71f60 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:49.669117 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-78b5265e-a195-4540-86c5-5d1787e71f60 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:49.669894 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-78b5265e-a195-4540-86c5-5d1787e71f60 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:49.670547 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-78b5265e-a195-4540-86c5-5d1787e71f60 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:49.686343 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-482e878c-f549-4f3e-9c4b-30db26b91554 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:49.694591 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-482e878c-f549-4f3e-9c4b-30db26b91554 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f" status: 200 len: 1366 microversion: 2.1 time: 0.228468 May 26 12:39:49.695523 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 395/777] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:49 2022] GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:49.711716 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:49.717165 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-78b5265e-a195-4540-86c5-5d1787e71f60 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061436 May 26 12:39:49.717727 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 383/778] 10.222.0.39 () {60 vars in 1342 bytes} [Thu May 26 12:39:49 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 12:39:50.040246 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-251dfdff-f3f7-4248-8e28-3dbdeec8dd22 req-29df8120-c6e4-473d-99a3-44da96a25892 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0db35800-34bb-4fda-bbb9-971062a3b16f", "tag": "6b85733d-334f-4218-a3f1-86407b989e88"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:50.048802 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-251dfdff-f3f7-4248-8e28-3dbdeec8dd22 req-29df8120-c6e4-473d-99a3-44da96a25892 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:50.049591 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-251dfdff-f3f7-4248-8e28-3dbdeec8dd22 req-29df8120-c6e4-473d-99a3-44da96a25892 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:50.063827 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-251dfdff-f3f7-4248-8e28-3dbdeec8dd22 req-29df8120-c6e4-473d-99a3-44da96a25892 service nova] Creating event network-changed:6b85733d-334f-4218-a3f1-86407b989e88 for instance 0db35800-34bb-4fda-bbb9-971062a3b16f on hv-cinder-81514 May 26 12:39:50.073266 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-251dfdff-f3f7-4248-8e28-3dbdeec8dd22 req-29df8120-c6e4-473d-99a3-44da96a25892 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037066 May 26 12:39:50.074214 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 396/779] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:39:50.711965 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-08d6c164-73ff-4bac-b837-9ca3556c75b5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:50.712579 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-08d6c164-73ff-4bac-b837-9ca3556c75b5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:50.720171 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-08d6c164-73ff-4bac-b837-9ca3556c75b5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:50.720653 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-08d6c164-73ff-4bac-b837-9ca3556c75b5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:50.721498 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-08d6c164-73ff-4bac-b837-9ca3556c75b5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:50.721952 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-08d6c164-73ff-4bac-b837-9ca3556c75b5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:50.730310 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f6cb0558-c360-4fe0-830b-4b48cd78a711 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:50.731410 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f6cb0558-c360-4fe0-830b-4b48cd78a711 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:50.737689 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f6cb0558-c360-4fe0-830b-4b48cd78a711 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:50.738136 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f6cb0558-c360-4fe0-830b-4b48cd78a711 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:50.738898 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f6cb0558-c360-4fe0-830b-4b48cd78a711 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:50.739336 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f6cb0558-c360-4fe0-830b-4b48cd78a711 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:50.770658 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f6cb0558-c360-4fe0-830b-4b48cd78a711 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045211 May 26 12:39:50.771475 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 397/780] 10.222.0.39 () {60 vars in 1342 bytes} [Thu May 26 12:39:50 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:39:50.833389 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-2d870bfa-6e11-44a7-bbf0-909c64d58d74 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:50.834025 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-2d870bfa-6e11-44a7-bbf0-909c64d58d74 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:50.841111 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2d870bfa-6e11-44a7-bbf0-909c64d58d74 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:50.841656 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2d870bfa-6e11-44a7-bbf0-909c64d58d74 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:50.842507 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2d870bfa-6e11-44a7-bbf0-909c64d58d74 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:50.843016 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2d870bfa-6e11-44a7-bbf0-909c64d58d74 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:50.864592 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-08d6c164-73ff-4bac-b837-9ca3556c75b5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:50.868947 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-2d870bfa-6e11-44a7-bbf0-909c64d58d74 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Going to try to terminate instance {{(pid=124133) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:39:50.872759 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-08d6c164-73ff-4bac-b837-9ca3556c75b5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f" status: 200 len: 1366 microversion: 2.1 time: 0.165186 May 26 12:39:50.873348 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 384/781] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:50 2022] GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:50.946577 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-2d870bfa-6e11-44a7-bbf0-909c64d58d74 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 204 len: 0 microversion: 2.20 time: 0.116867 May 26 12:39:50.947186 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 398/782] 10.222.0.39 () {60 vars in 1279 bytes} [Thu May 26 12:39:50 2022] DELETE /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 12:39:50.955365 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-82e6772a-64c2-4cce-9147-4a465ec904ca tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:50.955970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-82e6772a-64c2-4cce-9147-4a465ec904ca tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:50.962861 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-82e6772a-64c2-4cce-9147-4a465ec904ca tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:50.963246 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-82e6772a-64c2-4cce-9147-4a465ec904ca tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:50.964010 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-82e6772a-64c2-4cce-9147-4a465ec904ca tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:50.964447 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-82e6772a-64c2-4cce-9147-4a465ec904ca tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:51.102158 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-82e6772a-64c2-4cce-9147-4a465ec904ca tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:51.110467 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-82e6772a-64c2-4cce-9147-4a465ec904ca tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:51.111985 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-82e6772a-64c2-4cce-9147-4a465ec904ca tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:51.113195 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-82e6772a-64c2-4cce-9147-4a465ec904ca tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.161766 May 26 12:39:51.113750 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 385/783] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:39:50 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:39:51.891149 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-8780172b-11e0-4eac-9a99-e92fabb16d3a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:51.891880 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-8780172b-11e0-4eac-9a99-e92fabb16d3a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:51.899132 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8780172b-11e0-4eac-9a99-e92fabb16d3a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:51.899579 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8780172b-11e0-4eac-9a99-e92fabb16d3a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:51.900345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8780172b-11e0-4eac-9a99-e92fabb16d3a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:51.900820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8780172b-11e0-4eac-9a99-e92fabb16d3a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:52.033500 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-8780172b-11e0-4eac-9a99-e92fabb16d3a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:52.041848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-8780172b-11e0-4eac-9a99-e92fabb16d3a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f" status: 200 len: 1366 microversion: 2.1 time: 0.155323 May 26 12:39:52.042425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 399/784] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:51 2022] GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:52.135369 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-154d2bc0-bb48-4655-b621-4049c2fece2e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:52.135968 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-154d2bc0-bb48-4655-b621-4049c2fece2e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:52.142853 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-154d2bc0-bb48-4655-b621-4049c2fece2e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:52.143237 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-154d2bc0-bb48-4655-b621-4049c2fece2e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:52.143990 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-154d2bc0-bb48-4655-b621-4049c2fece2e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:52.144423 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-154d2bc0-bb48-4655-b621-4049c2fece2e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:52.281245 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-154d2bc0-bb48-4655-b621-4049c2fece2e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:52.289392 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-154d2bc0-bb48-4655-b621-4049c2fece2e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:52.290906 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-154d2bc0-bb48-4655-b621-4049c2fece2e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:52.292051 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-154d2bc0-bb48-4655-b621-4049c2fece2e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.160691 May 26 12:39:52.292598 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 386/785] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:39:52 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:39:53.058659 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-67e1572a-34ab-4d35-b8f2-01235323d2d7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:53.059264 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-67e1572a-34ab-4d35-b8f2-01235323d2d7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:53.065756 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-67e1572a-34ab-4d35-b8f2-01235323d2d7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:53.066204 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-67e1572a-34ab-4d35-b8f2-01235323d2d7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:53.066955 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-67e1572a-34ab-4d35-b8f2-01235323d2d7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:53.067391 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-67e1572a-34ab-4d35-b8f2-01235323d2d7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:53.202867 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-67e1572a-34ab-4d35-b8f2-01235323d2d7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:53.210861 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-67e1572a-34ab-4d35-b8f2-01235323d2d7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f" status: 200 len: 1366 microversion: 2.1 time: 0.155392 May 26 12:39:53.211428 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 400/786] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:53 2022] GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:53.310929 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-1b846713-ead1-4ee9-b9a7-a7706c1936a2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:53.311508 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-1b846713-ead1-4ee9-b9a7-a7706c1936a2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:53.317987 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1b846713-ead1-4ee9-b9a7-a7706c1936a2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:53.318434 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1b846713-ead1-4ee9-b9a7-a7706c1936a2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:53.319787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1b846713-ead1-4ee9-b9a7-a7706c1936a2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:53.320239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1b846713-ead1-4ee9-b9a7-a7706c1936a2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:53.453133 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-1b846713-ead1-4ee9-b9a7-a7706c1936a2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:53.461097 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-1b846713-ead1-4ee9-b9a7-a7706c1936a2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:53.462676 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-1b846713-ead1-4ee9-b9a7-a7706c1936a2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:53.463827 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-1b846713-ead1-4ee9-b9a7-a7706c1936a2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.156860 May 26 12:39:53.464374 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 387/787] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:39:53 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:39:54.228476 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-50d8cc5b-c5f4-4e72-9374-16f2f31bd588 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:54.229115 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-50d8cc5b-c5f4-4e72-9374-16f2f31bd588 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:54.235736 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-50d8cc5b-c5f4-4e72-9374-16f2f31bd588 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:54.236180 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-50d8cc5b-c5f4-4e72-9374-16f2f31bd588 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:54.236979 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-50d8cc5b-c5f4-4e72-9374-16f2f31bd588 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:54.237415 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-50d8cc5b-c5f4-4e72-9374-16f2f31bd588 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:54.240082 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:54.374068 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-50d8cc5b-c5f4-4e72-9374-16f2f31bd588 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:54.381377 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-50d8cc5b-c5f4-4e72-9374-16f2f31bd588 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f" status: 200 len: 1366 microversion: 2.1 time: 0.157460 May 26 12:39:54.381999 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 401/788] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:54 2022] GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:54.482442 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-251ac81c-2a3b-488d-b20d-5f9993e52782 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:54.483015 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-251ac81c-2a3b-488d-b20d-5f9993e52782 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:54.489453 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-251ac81c-2a3b-488d-b20d-5f9993e52782 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:54.489901 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-251ac81c-2a3b-488d-b20d-5f9993e52782 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:54.490663 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-251ac81c-2a3b-488d-b20d-5f9993e52782 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:54.491238 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-251ac81c-2a3b-488d-b20d-5f9993e52782 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:54.622639 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-251ac81c-2a3b-488d-b20d-5f9993e52782 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:54.630598 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-251ac81c-2a3b-488d-b20d-5f9993e52782 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:54.632727 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-251ac81c-2a3b-488d-b20d-5f9993e52782 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:54.634023 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-251ac81c-2a3b-488d-b20d-5f9993e52782 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.155625 May 26 12:39:54.634583 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 388/789] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:39:54 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:39:55.399070 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e968c29c-4fa7-4045-b9f7-2d0c29ed1d5c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:55.399687 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e968c29c-4fa7-4045-b9f7-2d0c29ed1d5c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:55.406384 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e968c29c-4fa7-4045-b9f7-2d0c29ed1d5c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:55.406766 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e968c29c-4fa7-4045-b9f7-2d0c29ed1d5c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:55.407536 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e968c29c-4fa7-4045-b9f7-2d0c29ed1d5c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:55.407975 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e968c29c-4fa7-4045-b9f7-2d0c29ed1d5c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:55.542727 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e968c29c-4fa7-4045-b9f7-2d0c29ed1d5c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:55.550429 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e968c29c-4fa7-4045-b9f7-2d0c29ed1d5c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f" status: 200 len: 1366 microversion: 2.1 time: 0.155594 May 26 12:39:55.551013 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 402/790] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:55 2022] GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:55.653413 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-075ef066-3d77-4238-bbeb-0cb9b2441773 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:55.654013 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-075ef066-3d77-4238-bbeb-0cb9b2441773 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:55.660811 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-075ef066-3d77-4238-bbeb-0cb9b2441773 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:55.661185 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-075ef066-3d77-4238-bbeb-0cb9b2441773 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:55.661989 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-075ef066-3d77-4238-bbeb-0cb9b2441773 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:55.662424 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-075ef066-3d77-4238-bbeb-0cb9b2441773 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:55.864481 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-075ef066-3d77-4238-bbeb-0cb9b2441773 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:55.873823 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-075ef066-3d77-4238-bbeb-0cb9b2441773 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:55.875369 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-075ef066-3d77-4238-bbeb-0cb9b2441773 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:55.876613 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-075ef066-3d77-4238-bbeb-0cb9b2441773 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1725 microversion: 2.20 time: 0.227077 May 26 12:39:55.887992 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 389/791] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:39:55 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1725 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:39:56.567733 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-43d05215-93d3-4918-83b6-c365984ccde7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:56.568339 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-43d05215-93d3-4918-83b6-c365984ccde7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:56.575311 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-43d05215-93d3-4918-83b6-c365984ccde7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:56.575960 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-43d05215-93d3-4918-83b6-c365984ccde7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:56.576748 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-43d05215-93d3-4918-83b6-c365984ccde7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:56.577199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-43d05215-93d3-4918-83b6-c365984ccde7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:56.712208 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-43d05215-93d3-4918-83b6-c365984ccde7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:56.719949 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-43d05215-93d3-4918-83b6-c365984ccde7 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f" status: 200 len: 1366 microversion: 2.1 time: 0.155955 May 26 12:39:56.720537 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 403/792] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:56 2022] GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:56.896501 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-09844a31-3077-44cf-b1dc-0eb9a71f46fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:56.897171 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-09844a31-3077-44cf-b1dc-0eb9a71f46fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:56.904259 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-09844a31-3077-44cf-b1dc-0eb9a71f46fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:56.904727 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-09844a31-3077-44cf-b1dc-0eb9a71f46fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:56.905514 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-09844a31-3077-44cf-b1dc-0eb9a71f46fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:56.906211 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-09844a31-3077-44cf-b1dc-0eb9a71f46fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:56.928383 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-44b6fb5d-ba8d-4734-bb43-8594d1e00b80 req-c4e616f4-c586-4e2b-9cbb-dec5f7a16b2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7af16d0b-59c7-43ea-856c-ec79029b680c", "name": "network-vif-deleted", "tag": "b1b5ee45-e743-4819-bc49-534e21eec9a7"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:56.939269 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-44b6fb5d-ba8d-4734-bb43-8594d1e00b80 req-c4e616f4-c586-4e2b-9cbb-dec5f7a16b2f service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:56.939953 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-44b6fb5d-ba8d-4734-bb43-8594d1e00b80 req-c4e616f4-c586-4e2b-9cbb-dec5f7a16b2f service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:56.962240 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-44b6fb5d-ba8d-4734-bb43-8594d1e00b80 req-c4e616f4-c586-4e2b-9cbb-dec5f7a16b2f service nova] Creating event network-vif-deleted:b1b5ee45-e743-4819-bc49-534e21eec9a7 for instance 7af16d0b-59c7-43ea-856c-ec79029b680c on hv-cinder-81514 May 26 12:39:56.968605 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-44b6fb5d-ba8d-4734-bb43-8594d1e00b80 req-c4e616f4-c586-4e2b-9cbb-dec5f7a16b2f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044183 May 26 12:39:56.969257 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 404/793] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:39:56.985136 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-09844a31-3077-44cf-b1dc-0eb9a71f46fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:56.994249 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-09844a31-3077-44cf-b1dc-0eb9a71f46fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:56.995792 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-09844a31-3077-44cf-b1dc-0eb9a71f46fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:56.996959 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-09844a31-3077-44cf-b1dc-0eb9a71f46fb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 200 len: 1657 microversion: 2.20 time: 0.105919 May 26 12:39:56.997507 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 390/794] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:39:56 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 1657 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:39:57.453443 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-bdabf6d0-7e83-4ba0-a6e4-9d8896433d1f req-1879f55a-7b7a-42f2-bb35-2d995c32d565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0db35800-34bb-4fda-bbb9-971062a3b16f", "name": "network-vif-plugged", "status": "completed", "tag": "6b85733d-334f-4218-a3f1-86407b989e88"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:57.457294 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=6 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:57.468460 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-bdabf6d0-7e83-4ba0-a6e4-9d8896433d1f req-1879f55a-7b7a-42f2-bb35-2d995c32d565 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:57.468948 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-bdabf6d0-7e83-4ba0-a6e4-9d8896433d1f req-1879f55a-7b7a-42f2-bb35-2d995c32d565 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:57.481356 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-bdabf6d0-7e83-4ba0-a6e4-9d8896433d1f req-1879f55a-7b7a-42f2-bb35-2d995c32d565 service nova] Creating event network-vif-plugged:6b85733d-334f-4218-a3f1-86407b989e88 for instance 0db35800-34bb-4fda-bbb9-971062a3b16f on hv-cinder-81514 May 26 12:39:57.486883 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-bdabf6d0-7e83-4ba0-a6e4-9d8896433d1f req-1879f55a-7b7a-42f2-bb35-2d995c32d565 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036833 May 26 12:39:57.486883 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 405/795] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:39:57.737109 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-34ae9b45-0eb7-481d-aabc-af87fcee4ff0 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:57.738047 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-34ae9b45-0eb7-481d-aabc-af87fcee4ff0 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:57.740258 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell0:SELECT=2 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:57.741047 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell0:SELECT=6 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:57.748396 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-34ae9b45-0eb7-481d-aabc-af87fcee4ff0 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:57.749316 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-34ae9b45-0eb7-481d-aabc-af87fcee4ff0 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:57.750303 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-34ae9b45-0eb7-481d-aabc-af87fcee4ff0 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:57.750717 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-34ae9b45-0eb7-481d-aabc-af87fcee4ff0 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:57.886546 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-34ae9b45-0eb7-481d-aabc-af87fcee4ff0 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:57.894442 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-34ae9b45-0eb7-481d-aabc-af87fcee4ff0 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f" status: 200 len: 1366 microversion: 2.1 time: 0.161545 May 26 12:39:57.895000 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 391/796] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:57 2022] GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:58.017060 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-be383328-5a86-43c4-ae63-3d9a3825aeaf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:58.017883 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-be383328-5a86-43c4-ae63-3d9a3825aeaf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:58.024541 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-be383328-5a86-43c4-ae63-3d9a3825aeaf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:58.025020 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-be383328-5a86-43c4-ae63-3d9a3825aeaf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:58.025785 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-be383328-5a86-43c4-ae63-3d9a3825aeaf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:58.026226 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-be383328-5a86-43c4-ae63-3d9a3825aeaf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:58.040154 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-be383328-5a86-43c4-ae63-3d9a3825aeaf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] HTTP exception thrown: Instance 7af16d0b-59c7-43ea-856c-ec79029b680c could not be found. May 26 12:39:58.041818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-be383328-5a86-43c4-ae63-3d9a3825aeaf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Request method failure captured: May 26 12:39:58.041818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c HTTP/1.1 May 26 12:39:58.041818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:39:58.041818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:39:58.041818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:39:58.041818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:39:58.041818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:39:58.041818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:39:58.041818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:39:58.041818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:39:58.041818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3NupQ99bdm0jSYtBpFOsR_TpeZZBFaPjT6l5q8y92nkUanj933uElOcB1O4u6r9jKp9lNpjs6xH0xR_cLoz5pmuJvw1elutYyrD-SzLOSA2pQ1M-mifWxzqkZCOqaG-rR2dl3EmFfEaetSOx7i4l7GX0qf4YfrlFCh6hWL2MN5BV5w May 26 12:39:58.041818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:39:58.041818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:39:58.041818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:39:58.041818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:39:58.041818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Openstack-Nova-Api-Version: 2.20 May 26 12:39:58.041818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:39:58.041818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:39:58.041818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: 978105ae032049cd85c3b1c061d10a24 May 26 12:39:58.041818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-282052064 May 26 12:39:58.041818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:39:58.041818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:39:58.043450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/978105ae032049cd85c3b1c061d10a24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_978105ae032049cd85c3b1c061d10a24", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/978105ae032049cd85c3b1c061d10a24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/978105ae032049cd85c3b1c061d10a24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:39:58.043450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-AttachVolumeShelveTestJSON-282052064 May 26 12:39:58.043450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: 978105ae032049cd85c3b1c061d10a24 May 26 12:39:58.043450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-282052064 May 26 12:39:58.043450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-AttachVolumeShelveTestJSON-282052064-project May 26 12:39:58.043450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:39:58.043450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:39:58.043450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: c90e6a7a7265480ca4c817d633da4a1d May 26 12:39:58.043450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-AttachVolumeShelveTestJSON-282052064-project May 26 12:39:58.043450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: > May 26 12:39:58.043450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Instance 7af16d0b-59c7-43ea-856c-ec79029b680c could not be found. May 26 12:39:58.043450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': '7af16d0b-59c7-43ea-856c-ec79029b680c'} May 26 12:39:58.044246 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:39:58.044246 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:39:58.044246 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:39:58.044246 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:39:58.044246 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:39:58.044246 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:39:58.044246 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:39:58.044246 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:39:58.044246 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:39:58.044246 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:39:58.044246 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7af16d0b-59c7-43ea-856c-ec79029b680c could not be found. May 26 12:39:58.044246 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:39:58.044246 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:39:58.044246 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:39:58.044246 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:39:58.044246 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:39:58.044246 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:39:58.044246 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:39:58.044246 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:39:58.044246 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:39:58.045499 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:39:58.045499 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:39:58.045499 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:39:58.045499 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:39:58.045499 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:39:58.045499 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:39:58.045499 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:39:58.045499 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7af16d0b-59c7-43ea-856c-ec79029b680c could not be found. May 26 12:39:58.045499 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:39:58.045499 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:39:58.045499 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:39:58.045499 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:39:58.045499 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:39:58.045499 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:39:58.045499 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:39:58.045499 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:39:58.045499 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7af16d0b-59c7-43ea-856c-ec79029b680c could not be found. May 26 12:39:58.045499 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:39:58.046563 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-be383328-5a86-43c4-ae63-3d9a3825aeaf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Returning 404 to user: Instance 7af16d0b-59c7-43ea-856c-ec79029b680c could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:39:58.046563 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-be383328-5a86-43c4-ae63-3d9a3825aeaf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 404 len: 111 microversion: 2.20 time: 0.031161 May 26 12:39:58.046563 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 406/797] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:39:58 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 12:39:58.052043 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-bf9acbb9-4136-4570-baf4-78c965ae205f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '.version_select at 0x7fed31331310>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:58.068942 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-bf9acbb9-4136-4570-baf4-78c965ae205f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1023879281" status: 204 len: 0 microversion: 2.20 time: 0.020668 May 26 12:39:58.069837 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 392/798] 10.222.0.39 () {60 vars in 1261 bytes} [Thu May 26 12:39:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1023879281 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 12:39:58.728501 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-8257ad9b-1e19-465d-87df-1171ba599abe tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Action: 'create', calling method: .version_select at 0x7fed313ed0d0>, body: {"keypair": {"name": "tempest-keypair-409721583", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuiflucAskALFPR3ejigEcbP/rOL3uQhTemMyUcCA6juiNssE58kWV3BqAwcLjl3reL6B2jy7g1RZWv1y/KWSQrJMyXQpvoHX19Q1PkYUBN+kndR6U74hJCtN1AYlntQg=="}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:39:58.742950 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-8257ad9b-1e19-465d-87df-1171ba599abe tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Getting quotas for project 978105ae032049cd85c3b1c061d10a24. Resources: {'key_pairs'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:39:58.747179 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-8257ad9b-1e19-465d-87df-1171ba599abe tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Getting quotas for user c90e6a7a7265480ca4c817d633da4a1d and project 978105ae032049cd85c3b1c061d10a24. Resources: {'key_pairs'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:39:58.773855 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-8257ad9b-1e19-465d-87df-1171ba599abe tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.049160 May 26 12:39:58.774723 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 407/799] 10.222.0.39 () {62 vars in 1199 bytes} [Thu May 26 12:39:58 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 12:39:58.911987 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-c4d2febd-ad4a-48ad-a317-d30f7d19bafa tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:58.912484 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-c4d2febd-ad4a-48ad-a317-d30f7d19bafa tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:39:58.919514 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c4d2febd-ad4a-48ad-a317-d30f7d19bafa tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:58.920558 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c4d2febd-ad4a-48ad-a317-d30f7d19bafa tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:58.920860 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c4d2febd-ad4a-48ad-a317-d30f7d19bafa tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:39:58.921630 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c4d2febd-ad4a-48ad-a317-d30f7d19bafa tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:39:59.063408 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c4d2febd-ad4a-48ad-a317-d30f7d19bafa tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:39:59.072459 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-c4d2febd-ad4a-48ad-a317-d30f7d19bafa tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f" status: 200 len: 1366 microversion: 2.1 time: 0.164469 May 26 12:39:59.073059 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 393/800] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:39:58 2022] GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:00.041824 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e6e1d295-aca4-4afc-b55a-acf4806782e3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-517567894", "imageRef": "7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f4f4055-c859-4f47-a2b3-80b425f2f227"}], "security_groups": [{"name": "tempest-securitygroup--947215022"}], "key_name": "tempest-keypair-409721583", "user_data": "}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:40:00.090190 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-094e263e-aa86-462b-bedd-ac1cc9b0ff23 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:00.090806 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-094e263e-aa86-462b-bedd-ac1cc9b0ff23 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:00.097424 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-094e263e-aa86-462b-bedd-ac1cc9b0ff23 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:00.097876 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-094e263e-aa86-462b-bedd-ac1cc9b0ff23 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:00.098675 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-094e263e-aa86-462b-bedd-ac1cc9b0ff23 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:00.099118 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-094e263e-aa86-462b-bedd-ac1cc9b0ff23 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:00.180883 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.network.neutron [None req-e6e1d295-aca4-4afc-b55a-acf4806782e3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] validate_networks() for [('2f4f4055-c859-4f47-a2b3-80b425f2f227', None, None, None, None, None)] {{(pid=124133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:40:00.314113 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-094e263e-aa86-462b-bedd-ac1cc9b0ff23 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:00.321956 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-094e263e-aa86-462b-bedd-ac1cc9b0ff23 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f" status: 200 len: 1556 microversion: 2.1 time: 0.235619 May 26 12:40:00.322529 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 394/801] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:00 2022] GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f => generated 1556 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:40:00.339960 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-63e6f2a0-2763-4cfe-978a-44e7ca770bca tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:00.340873 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-63e6f2a0-2763-4cfe-978a-44e7ca770bca tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:00.347977 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-63e6f2a0-2763-4cfe-978a-44e7ca770bca tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:00.348438 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-63e6f2a0-2763-4cfe-978a-44e7ca770bca tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:00.349254 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-63e6f2a0-2763-4cfe-978a-44e7ca770bca tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:00.349697 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-63e6f2a0-2763-4cfe-978a-44e7ca770bca tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:00.702442 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-63e6f2a0-2763-4cfe-978a-44e7ca770bca tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.368261 May 26 12:40:00.703057 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 395/802] 10.222.0.39 () {58 vars in 1274 bytes} [Thu May 26 12:40:00 2022] GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f/os-interface => generated 284 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:40:01.179471 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-e6e1d295-aca4-4afc-b55a-acf4806782e3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Flavor limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:40:01.179986 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-e6e1d295-aca4-4afc-b55a-acf4806782e3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Image limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:40:01.180368 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-e6e1d295-aca4-4afc-b55a-acf4806782e3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Flavor pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:40:01.180807 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-e6e1d295-aca4-4afc-b55a-acf4806782e3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Image pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:40:01.181223 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-e6e1d295-aca4-4afc-b55a-acf4806782e3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:40:01.190128 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e6e1d295-aca4-4afc-b55a-acf4806782e3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:01.190581 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e6e1d295-aca4-4afc-b55a-acf4806782e3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:01.191380 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e6e1d295-aca4-4afc-b55a-acf4806782e3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:01.191819 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e6e1d295-aca4-4afc-b55a-acf4806782e3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:01.209437 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-e6e1d295-aca4-4afc-b55a-acf4806782e3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Getting quotas for project 978105ae032049cd85c3b1c061d10a24. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:40:01.214046 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-e6e1d295-aca4-4afc-b55a-acf4806782e3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Getting quotas for user c90e6a7a7265480ca4c817d633da4a1d and project 978105ae032049cd85c3b1c061d10a24. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:40:01.224995 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e6e1d295-aca4-4afc-b55a-acf4806782e3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Going to run 1 instances... {{(pid=124133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:40:01.227766 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e6e1d295-aca4-4afc-b55a-acf4806782e3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:40:01.247535 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:01.275971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e6e1d295-aca4-4afc-b55a-acf4806782e3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.239743 May 26 12:40:01.276822 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 408/803] 10.222.0.39 () {62 vars in 1187 bytes} [Thu May 26 12:40:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 1241 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 12:40:01.287615 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-8527ef9f-e559-4008-a452-9308977a59fc tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:01.288919 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-8527ef9f-e559-4008-a452-9308977a59fc tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:01.384206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-8527ef9f-e559-4008-a452-9308977a59fc tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:01.407905 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-8527ef9f-e559-4008-a452-9308977a59fc tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:01.411788 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-8527ef9f-e559-4008-a452-9308977a59fc tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:01.413095 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-8527ef9f-e559-4008-a452-9308977a59fc tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1280 microversion: 2.20 time: 0.130125 May 26 12:40:01.413677 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 396/804] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:40:01 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1280 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:40:01.558921 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-122f6488-63ca-4705-9fcd-9105ccd3ffcb tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:01.559435 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-122f6488-63ca-4705-9fcd-9105ccd3ffcb tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:01.565954 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-122f6488-63ca-4705-9fcd-9105ccd3ffcb tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:01.566423 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-122f6488-63ca-4705-9fcd-9105ccd3ffcb tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:01.567480 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-122f6488-63ca-4705-9fcd-9105ccd3ffcb tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:01.568140 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-122f6488-63ca-4705-9fcd-9105ccd3ffcb tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:01.680739 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.objects.instance [None req-122f6488-63ca-4705-9fcd-9105ccd3ffcb tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lazy-loading 'services' on Instance uuid 1220de98-5d9e-4c46-937d-52199dd249c3 {{(pid=124133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:40:01.760203 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-122f6488-63ca-4705-9fcd-9105ccd3ffcb tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3/os-volume_attachments/4bbe03ba-7fef-467d-886d-f20015924335" status: 202 len: 0 microversion: 2.1 time: 0.365670 May 26 12:40:01.760899 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 409/805] 10.222.0.39 () {58 vars in 1415 bytes} [Thu May 26 12:40:01 2022] DELETE /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3/os-volume_attachments/4bbe03ba-7fef-467d-886d-f20015924335 => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 12:40:01.946145 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-2a16fb84-9951-417d-89f6-57d9d0754248 req-deacfa6f-7138-4825-9703-fbad838dbd84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0db35800-34bb-4fda-bbb9-971062a3b16f", "tag": "6b85733d-334f-4218-a3f1-86407b989e88"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:40:01.950792 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:01.956358 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-2a16fb84-9951-417d-89f6-57d9d0754248 req-deacfa6f-7138-4825-9703-fbad838dbd84 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:01.956838 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-2a16fb84-9951-417d-89f6-57d9d0754248 req-deacfa6f-7138-4825-9703-fbad838dbd84 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:01.969863 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-2a16fb84-9951-417d-89f6-57d9d0754248 req-deacfa6f-7138-4825-9703-fbad838dbd84 service nova] Creating event network-changed:6b85733d-334f-4218-a3f1-86407b989e88 for instance 0db35800-34bb-4fda-bbb9-971062a3b16f on hv-cinder-81514 May 26 12:40:01.975772 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-2a16fb84-9951-417d-89f6-57d9d0754248 req-deacfa6f-7138-4825-9703-fbad838dbd84 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033977 May 26 12:40:01.976760 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 397/806] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:40:02.430966 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-bd9126d1-0bae-4d5b-a441-e92151f3f0cf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:02.431807 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-bd9126d1-0bae-4d5b-a441-e92151f3f0cf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:02.438735 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bd9126d1-0bae-4d5b-a441-e92151f3f0cf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:02.439191 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bd9126d1-0bae-4d5b-a441-e92151f3f0cf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:02.439963 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bd9126d1-0bae-4d5b-a441-e92151f3f0cf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:02.440406 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bd9126d1-0bae-4d5b-a441-e92151f3f0cf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:02.505629 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-bd9126d1-0bae-4d5b-a441-e92151f3f0cf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:02.514761 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-bd9126d1-0bae-4d5b-a441-e92151f3f0cf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:02.516346 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-bd9126d1-0bae-4d5b-a441-e92151f3f0cf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:02.517589 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-bd9126d1-0bae-4d5b-a441-e92151f3f0cf tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1332 microversion: 2.20 time: 0.091039 May 26 12:40:02.518214 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 410/807] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:40:02 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1332 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:40:03.538067 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-7dec8555-a787-4986-b58c-cfb5f025d8dc tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:03.538793 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-7dec8555-a787-4986-b58c-cfb5f025d8dc tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:03.545768 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7dec8555-a787-4986-b58c-cfb5f025d8dc tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:03.546220 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7dec8555-a787-4986-b58c-cfb5f025d8dc tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:03.546997 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7dec8555-a787-4986-b58c-cfb5f025d8dc tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:03.547437 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7dec8555-a787-4986-b58c-cfb5f025d8dc tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:03.619433 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-7dec8555-a787-4986-b58c-cfb5f025d8dc tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:03.627683 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-7dec8555-a787-4986-b58c-cfb5f025d8dc tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:03.629213 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-7dec8555-a787-4986-b58c-cfb5f025d8dc tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:03.630307 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-7dec8555-a787-4986-b58c-cfb5f025d8dc tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1338 microversion: 2.20 time: 0.097502 May 26 12:40:03.630858 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 398/808] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:40:03 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1338 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:40:03.947288 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-dd3f23ed-6374-4be3-a83a-aee5bb6b6163 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:40:03.954655 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dd3f23ed-6374-4be3-a83a-aee5bb6b6163 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:03.955200 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dd3f23ed-6374-4be3-a83a-aee5bb6b6163 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:04.020539 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-dd3f23ed-6374-4be3-a83a-aee5bb6b6163 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Going to try to stop instance {{(pid=124133) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 12:40:04.067072 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-dd3f23ed-6374-4be3-a83a-aee5bb6b6163 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "POST /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3/action" status: 202 len: 0 microversion: 2.1 time: 0.123550 May 26 12:40:04.068093 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 411/809] 10.222.0.39 () {60 vars in 1277 bytes} [Thu May 26 12:40:03 2022] POST /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:40:04.076412 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-023da1c6-d68a-4ba6-936a-3d2c288441aa tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:04.077049 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-023da1c6-d68a-4ba6-936a-3d2c288441aa tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:04.085375 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-023da1c6-d68a-4ba6-936a-3d2c288441aa tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:04.085840 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-023da1c6-d68a-4ba6-936a-3d2c288441aa tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:04.086669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-023da1c6-d68a-4ba6-936a-3d2c288441aa tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:04.087244 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-023da1c6-d68a-4ba6-936a-3d2c288441aa tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:04.293390 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-023da1c6-d68a-4ba6-936a-3d2c288441aa tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:04.301595 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-023da1c6-d68a-4ba6-936a-3d2c288441aa tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1675 microversion: 2.1 time: 0.229090 May 26 12:40:04.302486 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 399/810] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:04 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1675 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:04.566509 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-6557ce73-ef91-4c1d-83e4-c0ce29dc70b3 req-e82238f8-bb5d-4d44-9495-58b8c1ab54e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2", "tag": "c3caaa3d-4347-42cd-a614-454eabf81b41"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:40:04.579417 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-6557ce73-ef91-4c1d-83e4-c0ce29dc70b3 req-e82238f8-bb5d-4d44-9495-58b8c1ab54e9 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:04.580258 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-6557ce73-ef91-4c1d-83e4-c0ce29dc70b3 req-e82238f8-bb5d-4d44-9495-58b8c1ab54e9 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:04.594882 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-6557ce73-ef91-4c1d-83e4-c0ce29dc70b3 req-e82238f8-bb5d-4d44-9495-58b8c1ab54e9 service nova] Creating event network-changed:c3caaa3d-4347-42cd-a614-454eabf81b41 for instance f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 on hv-cinder-81514 May 26 12:40:04.600856 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-6557ce73-ef91-4c1d-83e4-c0ce29dc70b3 req-e82238f8-bb5d-4d44-9495-58b8c1ab54e9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037884 May 26 12:40:04.601882 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 412/811] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:40:04.651304 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-5cf0e934-8889-4a43-9461-e2b82f45e34f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:04.652180 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-5cf0e934-8889-4a43-9461-e2b82f45e34f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:04.659311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5cf0e934-8889-4a43-9461-e2b82f45e34f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:04.659924 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5cf0e934-8889-4a43-9461-e2b82f45e34f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:04.660845 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5cf0e934-8889-4a43-9461-e2b82f45e34f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:04.661368 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5cf0e934-8889-4a43-9461-e2b82f45e34f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:04.898162 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-5cf0e934-8889-4a43-9461-e2b82f45e34f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:04.906367 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-5cf0e934-8889-4a43-9461-e2b82f45e34f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:04.907861 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-5cf0e934-8889-4a43-9461-e2b82f45e34f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:04.908987 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-5cf0e934-8889-4a43-9461-e2b82f45e34f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1405 microversion: 2.20 time: 0.263198 May 26 12:40:04.909554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 400/812] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:40:04 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1405 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:40:05.320434 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-7942c613-41cd-4172-9aa9-2593383dccf2 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:05.321193 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-7942c613-41cd-4172-9aa9-2593383dccf2 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:05.328088 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7942c613-41cd-4172-9aa9-2593383dccf2 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:05.328570 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7942c613-41cd-4172-9aa9-2593383dccf2 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:05.329363 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7942c613-41cd-4172-9aa9-2593383dccf2 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:05.329809 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7942c613-41cd-4172-9aa9-2593383dccf2 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:05.462572 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-7942c613-41cd-4172-9aa9-2593383dccf2 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:05.470013 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-7942c613-41cd-4172-9aa9-2593383dccf2 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1675 microversion: 2.1 time: 0.154619 May 26 12:40:05.470574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 413/813] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:05 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:40:05.927182 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-c5e64ab0-afe3-41a4-92d7-97da0a63e1cb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:05.927788 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-c5e64ab0-afe3-41a4-92d7-97da0a63e1cb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:05.935006 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c5e64ab0-afe3-41a4-92d7-97da0a63e1cb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:05.935448 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c5e64ab0-afe3-41a4-92d7-97da0a63e1cb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:05.936211 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c5e64ab0-afe3-41a4-92d7-97da0a63e1cb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:05.936652 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c5e64ab0-afe3-41a4-92d7-97da0a63e1cb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:06.071508 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c5e64ab0-afe3-41a4-92d7-97da0a63e1cb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:06.079438 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c5e64ab0-afe3-41a4-92d7-97da0a63e1cb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:06.080941 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c5e64ab0-afe3-41a4-92d7-97da0a63e1cb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:06.082027 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-c5e64ab0-afe3-41a4-92d7-97da0a63e1cb tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1405 microversion: 2.20 time: 0.158979 May 26 12:40:06.082578 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 401/814] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:40:05 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:40:06.488611 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-07590dc0-b21e-4c6e-9f0e-7c40cf21ca3a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:06.489246 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-07590dc0-b21e-4c6e-9f0e-7c40cf21ca3a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:06.496402 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-07590dc0-b21e-4c6e-9f0e-7c40cf21ca3a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:06.496923 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-07590dc0-b21e-4c6e-9f0e-7c40cf21ca3a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:06.497688 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-07590dc0-b21e-4c6e-9f0e-7c40cf21ca3a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:06.498129 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-07590dc0-b21e-4c6e-9f0e-7c40cf21ca3a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:06.636570 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-07590dc0-b21e-4c6e-9f0e-7c40cf21ca3a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:06.647104 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-07590dc0-b21e-4c6e-9f0e-7c40cf21ca3a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1675 microversion: 2.1 time: 0.162127 May 26 12:40:06.648043 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 414/815] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:06 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:07.099736 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-ac7edebd-b841-4356-a3c1-d3545a4d71e6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:07.101192 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-ac7edebd-b841-4356-a3c1-d3545a4d71e6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:07.107495 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ac7edebd-b841-4356-a3c1-d3545a4d71e6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:07.107950 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ac7edebd-b841-4356-a3c1-d3545a4d71e6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:07.108732 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ac7edebd-b841-4356-a3c1-d3545a4d71e6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:07.109198 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ac7edebd-b841-4356-a3c1-d3545a4d71e6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:07.244865 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ac7edebd-b841-4356-a3c1-d3545a4d71e6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:07.252924 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ac7edebd-b841-4356-a3c1-d3545a4d71e6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:07.254418 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ac7edebd-b841-4356-a3c1-d3545a4d71e6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:07.255510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-ac7edebd-b841-4356-a3c1-d3545a4d71e6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1405 microversion: 2.20 time: 0.159783 May 26 12:40:07.256066 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 402/816] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:40:07 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:40:07.669235 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-53a617ec-b33b-411b-8019-b83cef9f6cf8 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:07.669855 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-53a617ec-b33b-411b-8019-b83cef9f6cf8 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:07.676425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-53a617ec-b33b-411b-8019-b83cef9f6cf8 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:07.676911 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-53a617ec-b33b-411b-8019-b83cef9f6cf8 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:07.677711 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-53a617ec-b33b-411b-8019-b83cef9f6cf8 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:07.678684 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-53a617ec-b33b-411b-8019-b83cef9f6cf8 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:08.127270 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-53a617ec-b33b-411b-8019-b83cef9f6cf8 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:08.135086 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-53a617ec-b33b-411b-8019-b83cef9f6cf8 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1675 microversion: 2.1 time: 0.469615 May 26 12:40:08.135697 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 415/817] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:07 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1675 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:08.274773 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-42209f08-872f-47aa-8e18-14cd7073aa3a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:08.275387 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-42209f08-872f-47aa-8e18-14cd7073aa3a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:08.284110 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-42209f08-872f-47aa-8e18-14cd7073aa3a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:08.284565 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-42209f08-872f-47aa-8e18-14cd7073aa3a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:08.285386 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-42209f08-872f-47aa-8e18-14cd7073aa3a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:08.285837 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-42209f08-872f-47aa-8e18-14cd7073aa3a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:08.309049 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=100 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:08.505311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-42209f08-872f-47aa-8e18-14cd7073aa3a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:08.513821 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-42209f08-872f-47aa-8e18-14cd7073aa3a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:08.515395 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-42209f08-872f-47aa-8e18-14cd7073aa3a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:08.516497 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-42209f08-872f-47aa-8e18-14cd7073aa3a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1405 microversion: 2.20 time: 0.246462 May 26 12:40:08.517091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 403/818] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:40:08 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1405 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:40:09.152350 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-fa5f2247-ccd1-4271-9149-ed86c328ae85 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:09.152988 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-fa5f2247-ccd1-4271-9149-ed86c328ae85 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:09.159520 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fa5f2247-ccd1-4271-9149-ed86c328ae85 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:09.159983 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fa5f2247-ccd1-4271-9149-ed86c328ae85 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:09.160752 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fa5f2247-ccd1-4271-9149-ed86c328ae85 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:09.161193 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fa5f2247-ccd1-4271-9149-ed86c328ae85 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:09.294874 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-fa5f2247-ccd1-4271-9149-ed86c328ae85 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:09.302438 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-fa5f2247-ccd1-4271-9149-ed86c328ae85 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1675 microversion: 2.1 time: 0.153890 May 26 12:40:09.302991 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 416/819] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:09 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:09.535328 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-ecefb37a-8d5d-437c-b7f2-c158f43b28b2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:09.535930 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-ecefb37a-8d5d-437c-b7f2-c158f43b28b2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:09.542953 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ecefb37a-8d5d-437c-b7f2-c158f43b28b2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:09.543402 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ecefb37a-8d5d-437c-b7f2-c158f43b28b2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:09.544154 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ecefb37a-8d5d-437c-b7f2-c158f43b28b2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:09.544589 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ecefb37a-8d5d-437c-b7f2-c158f43b28b2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:09.673359 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ecefb37a-8d5d-437c-b7f2-c158f43b28b2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:09.682003 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ecefb37a-8d5d-437c-b7f2-c158f43b28b2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:09.683499 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ecefb37a-8d5d-437c-b7f2-c158f43b28b2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:09.684583 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-ecefb37a-8d5d-437c-b7f2-c158f43b28b2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1405 microversion: 2.20 time: 0.153197 May 26 12:40:09.685168 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 404/820] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:40:09 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:40:10.322071 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f9fea272-8f0e-49ef-99ba-138cc7526736 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:10.322665 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f9fea272-8f0e-49ef-99ba-138cc7526736 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:10.329357 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f9fea272-8f0e-49ef-99ba-138cc7526736 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:10.329804 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f9fea272-8f0e-49ef-99ba-138cc7526736 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:10.330554 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f9fea272-8f0e-49ef-99ba-138cc7526736 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:10.331015 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f9fea272-8f0e-49ef-99ba-138cc7526736 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:10.478399 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f9fea272-8f0e-49ef-99ba-138cc7526736 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:10.485955 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f9fea272-8f0e-49ef-99ba-138cc7526736 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1675 microversion: 2.1 time: 0.168378 May 26 12:40:10.486521 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 417/821] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:10 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:10.703842 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6f911144-f488-4a30-8010-769d6880473b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:10.704509 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-6f911144-f488-4a30-8010-769d6880473b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:10.711122 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6f911144-f488-4a30-8010-769d6880473b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:10.711567 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6f911144-f488-4a30-8010-769d6880473b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:10.712321 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6f911144-f488-4a30-8010-769d6880473b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:10.712787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6f911144-f488-4a30-8010-769d6880473b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:10.842532 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-6f911144-f488-4a30-8010-769d6880473b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:10.851898 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-6f911144-f488-4a30-8010-769d6880473b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:10.853584 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-6f911144-f488-4a30-8010-769d6880473b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:10.854684 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-6f911144-f488-4a30-8010-769d6880473b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1405 microversion: 2.20 time: 0.155044 May 26 12:40:10.855244 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 405/822] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:40:10 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:40:11.191314 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-6a3cff40-17c7-4b6a-882e-928b32f9eda1 req-91a6857b-8870-4531-8899-908d57cb90d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2", "name": "network-vif-plugged", "status": "completed", "tag": "c3caaa3d-4347-42cd-a614-454eabf81b41"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:40:11.200227 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=2 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:11.203018 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-6a3cff40-17c7-4b6a-882e-928b32f9eda1 req-91a6857b-8870-4531-8899-908d57cb90d7 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:11.203606 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-6a3cff40-17c7-4b6a-882e-928b32f9eda1 req-91a6857b-8870-4531-8899-908d57cb90d7 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:11.216698 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-6a3cff40-17c7-4b6a-882e-928b32f9eda1 req-91a6857b-8870-4531-8899-908d57cb90d7 service nova] Creating event network-vif-plugged:c3caaa3d-4347-42cd-a614-454eabf81b41 for instance f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 on hv-cinder-81514 May 26 12:40:11.220406 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=10 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:11.221900 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-6a3cff40-17c7-4b6a-882e-928b32f9eda1 req-91a6857b-8870-4531-8899-908d57cb90d7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036444 May 26 12:40:11.222816 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 418/823] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:40:11.506184 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-60c29b5f-5d42-4eab-a8be-9cd5ad4b39ed tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:11.507326 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-60c29b5f-5d42-4eab-a8be-9cd5ad4b39ed tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:11.509339 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell0:SELECT=2 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:11.515908 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-60c29b5f-5d42-4eab-a8be-9cd5ad4b39ed tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:11.516358 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-60c29b5f-5d42-4eab-a8be-9cd5ad4b39ed tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:11.517146 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-60c29b5f-5d42-4eab-a8be-9cd5ad4b39ed tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:11.517588 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-60c29b5f-5d42-4eab-a8be-9cd5ad4b39ed tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:11.653812 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-60c29b5f-5d42-4eab-a8be-9cd5ad4b39ed tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:11.661341 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-60c29b5f-5d42-4eab-a8be-9cd5ad4b39ed tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1675 microversion: 2.1 time: 0.159305 May 26 12:40:11.661843 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 406/824] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:11 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:40:11.876844 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f98f44cc-78d8-4941-9cf6-e7143be62590 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:11.877560 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f98f44cc-78d8-4941-9cf6-e7143be62590 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:11.885377 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f98f44cc-78d8-4941-9cf6-e7143be62590 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:11.885831 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f98f44cc-78d8-4941-9cf6-e7143be62590 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:11.886604 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f98f44cc-78d8-4941-9cf6-e7143be62590 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:11.887039 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f98f44cc-78d8-4941-9cf6-e7143be62590 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:12.020741 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f98f44cc-78d8-4941-9cf6-e7143be62590 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:12.029062 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f98f44cc-78d8-4941-9cf6-e7143be62590 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:12.030672 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f98f44cc-78d8-4941-9cf6-e7143be62590 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:12.031761 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f98f44cc-78d8-4941-9cf6-e7143be62590 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1405 microversion: 2.20 time: 0.160607 May 26 12:40:12.032338 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 419/825] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:40:11 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:40:12.679372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-5772963d-17cc-4c69-b685-f977525d5015 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:12.679953 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-5772963d-17cc-4c69-b685-f977525d5015 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:12.686725 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5772963d-17cc-4c69-b685-f977525d5015 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:12.687215 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5772963d-17cc-4c69-b685-f977525d5015 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:12.687983 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5772963d-17cc-4c69-b685-f977525d5015 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:12.688445 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5772963d-17cc-4c69-b685-f977525d5015 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:12.825227 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-5772963d-17cc-4c69-b685-f977525d5015 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:12.832973 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-5772963d-17cc-4c69-b685-f977525d5015 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1675 microversion: 2.1 time: 0.157902 May 26 12:40:12.833532 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 407/826] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:12 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:13.051359 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-79074d30-01ec-4275-965a-96d9fe4ebd61 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:13.051970 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-79074d30-01ec-4275-965a-96d9fe4ebd61 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:13.059188 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-79074d30-01ec-4275-965a-96d9fe4ebd61 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:13.059669 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-79074d30-01ec-4275-965a-96d9fe4ebd61 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:13.060434 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-79074d30-01ec-4275-965a-96d9fe4ebd61 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:13.060909 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-79074d30-01ec-4275-965a-96d9fe4ebd61 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:13.191644 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-79074d30-01ec-4275-965a-96d9fe4ebd61 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:13.200225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-79074d30-01ec-4275-965a-96d9fe4ebd61 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:13.201775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-79074d30-01ec-4275-965a-96d9fe4ebd61 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:13.202916 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-79074d30-01ec-4275-965a-96d9fe4ebd61 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1405 microversion: 2.20 time: 0.155404 May 26 12:40:13.203426 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 420/827] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:40:13 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:40:13.850967 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-5ddc3ea8-2949-485b-b3f9-e2e4b625729e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:13.851649 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-5ddc3ea8-2949-485b-b3f9-e2e4b625729e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:13.858123 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5ddc3ea8-2949-485b-b3f9-e2e4b625729e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:13.858570 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5ddc3ea8-2949-485b-b3f9-e2e4b625729e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:13.859324 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5ddc3ea8-2949-485b-b3f9-e2e4b625729e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:13.859758 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5ddc3ea8-2949-485b-b3f9-e2e4b625729e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:13.991694 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-5ddc3ea8-2949-485b-b3f9-e2e4b625729e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:14.002255 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-5ddc3ea8-2949-485b-b3f9-e2e4b625729e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1675 microversion: 2.1 time: 0.155808 May 26 12:40:14.002819 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 408/828] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:13 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:14.220947 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-c38c4044-42ca-47be-93bf-05009f553390 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:14.221556 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-c38c4044-42ca-47be-93bf-05009f553390 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:14.228260 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c38c4044-42ca-47be-93bf-05009f553390 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:14.228740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c38c4044-42ca-47be-93bf-05009f553390 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:14.229501 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c38c4044-42ca-47be-93bf-05009f553390 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:14.229941 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c38c4044-42ca-47be-93bf-05009f553390 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:14.232468 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:14.367397 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-c38c4044-42ca-47be-93bf-05009f553390 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:14.375291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-c38c4044-42ca-47be-93bf-05009f553390 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:14.376811 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-c38c4044-42ca-47be-93bf-05009f553390 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:14.377949 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-c38c4044-42ca-47be-93bf-05009f553390 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1597 microversion: 2.20 time: 0.161313 May 26 12:40:14.378499 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 421/829] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:40:14 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1597 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:40:14.396013 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-164672bd-97ac-4fc5-ae7a-5f23dd5d5a93 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:14.396503 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-164672bd-97ac-4fc5-ae7a-5f23dd5d5a93 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:14.403296 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-164672bd-97ac-4fc5-ae7a-5f23dd5d5a93 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:14.403738 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-164672bd-97ac-4fc5-ae7a-5f23dd5d5a93 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:14.404490 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-164672bd-97ac-4fc5-ae7a-5f23dd5d5a93 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:14.404946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-164672bd-97ac-4fc5-ae7a-5f23dd5d5a93 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:14.482660 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-164672bd-97ac-4fc5-ae7a-5f23dd5d5a93 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090424 May 26 12:40:14.483261 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 409/830] 10.222.0.39 () {60 vars in 1315 bytes} [Thu May 26 12:40:14 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:40:15.019703 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-0f10b076-5e75-4715-88f4-63b5901f327e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:15.020318 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-0f10b076-5e75-4715-88f4-63b5901f327e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:15.027405 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0f10b076-5e75-4715-88f4-63b5901f327e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:15.027864 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0f10b076-5e75-4715-88f4-63b5901f327e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:15.028647 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0f10b076-5e75-4715-88f4-63b5901f327e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:15.029121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0f10b076-5e75-4715-88f4-63b5901f327e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:15.267849 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-0f10b076-5e75-4715-88f4-63b5901f327e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:15.276398 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-0f10b076-5e75-4715-88f4-63b5901f327e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1675 microversion: 2.1 time: 0.260572 May 26 12:40:15.277197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 422/831] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:15 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1675 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:15.482894 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-721f8fc7-7adb-4a44-aac7-ec5cfa5506f0 req-563fe4f5-102f-449c-be9a-d238cee36175 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2", "tag": "c3caaa3d-4347-42cd-a614-454eabf81b41"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:40:15.492170 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-721f8fc7-7adb-4a44-aac7-ec5cfa5506f0 req-563fe4f5-102f-449c-be9a-d238cee36175 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:15.492623 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-721f8fc7-7adb-4a44-aac7-ec5cfa5506f0 req-563fe4f5-102f-449c-be9a-d238cee36175 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:15.503738 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-721f8fc7-7adb-4a44-aac7-ec5cfa5506f0 req-563fe4f5-102f-449c-be9a-d238cee36175 service nova] Creating event network-changed:c3caaa3d-4347-42cd-a614-454eabf81b41 for instance f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 on hv-cinder-81514 May 26 12:40:15.509737 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-721f8fc7-7adb-4a44-aac7-ec5cfa5506f0 req-563fe4f5-102f-449c-be9a-d238cee36175 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030929 May 26 12:40:15.510456 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 410/832] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:40:16.294235 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-932ffef9-8534-4c5c-8f6d-835a2eaec238 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:16.294799 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-932ffef9-8534-4c5c-8f6d-835a2eaec238 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:16.301434 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-932ffef9-8534-4c5c-8f6d-835a2eaec238 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:16.301888 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-932ffef9-8534-4c5c-8f6d-835a2eaec238 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:16.302831 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-932ffef9-8534-4c5c-8f6d-835a2eaec238 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:16.303762 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-932ffef9-8534-4c5c-8f6d-835a2eaec238 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:16.452363 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-932ffef9-8534-4c5c-8f6d-835a2eaec238 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:16.460499 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-932ffef9-8534-4c5c-8f6d-835a2eaec238 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1675 microversion: 2.1 time: 0.170753 May 26 12:40:16.461136 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 423/833] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:16 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:17.480160 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-ffc85dbf-77f7-4377-93a5-699caaaa83ed tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:17.480899 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-ffc85dbf-77f7-4377-93a5-699caaaa83ed tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:17.487562 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ffc85dbf-77f7-4377-93a5-699caaaa83ed tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:17.488010 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ffc85dbf-77f7-4377-93a5-699caaaa83ed tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:17.488792 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ffc85dbf-77f7-4377-93a5-699caaaa83ed tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:17.489234 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ffc85dbf-77f7-4377-93a5-699caaaa83ed tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:17.621354 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ffc85dbf-77f7-4377-93a5-699caaaa83ed tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:17.629891 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-ffc85dbf-77f7-4377-93a5-699caaaa83ed tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1675 microversion: 2.1 time: 0.154711 May 26 12:40:17.630451 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 411/834] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:17 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:18.647278 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-9035866d-2a69-4fc5-826f-a42c06331c29 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:18.647998 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-9035866d-2a69-4fc5-826f-a42c06331c29 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:18.654456 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9035866d-2a69-4fc5-826f-a42c06331c29 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:18.654902 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9035866d-2a69-4fc5-826f-a42c06331c29 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:18.655654 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9035866d-2a69-4fc5-826f-a42c06331c29 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:18.656089 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9035866d-2a69-4fc5-826f-a42c06331c29 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:18.781740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-9035866d-2a69-4fc5-826f-a42c06331c29 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:18.789263 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-9035866d-2a69-4fc5-826f-a42c06331c29 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1675 microversion: 2.1 time: 0.145831 May 26 12:40:18.789832 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 424/835] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:18 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1675 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:19.806964 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-50f1a0d2-e405-4989-a25c-4a48665398e0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:19.807640 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-50f1a0d2-e405-4989-a25c-4a48665398e0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:19.814377 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-50f1a0d2-e405-4989-a25c-4a48665398e0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:19.814822 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-50f1a0d2-e405-4989-a25c-4a48665398e0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:19.815576 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-50f1a0d2-e405-4989-a25c-4a48665398e0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:19.816009 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-50f1a0d2-e405-4989-a25c-4a48665398e0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:19.948387 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-50f1a0d2-e405-4989-a25c-4a48665398e0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:19.955849 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-50f1a0d2-e405-4989-a25c-4a48665398e0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1652 microversion: 2.1 time: 0.153167 May 26 12:40:19.956410 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 412/836] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:19 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1652 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:19.971908 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-58892dfb-4f62-4971-bca6-6fa911f5a975 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:40:19.978544 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-58892dfb-4f62-4971-bca6-6fa911f5a975 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:19.978994 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-58892dfb-4f62-4971-bca6-6fa911f5a975 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:20.000866 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-58892dfb-4f62-4971-bca6-6fa911f5a975 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Going to try to start instance {{(pid=124133) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 12:40:20.042291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-58892dfb-4f62-4971-bca6-6fa911f5a975 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "POST /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3/action" status: 202 len: 0 microversion: 2.1 time: 0.073960 May 26 12:40:20.042894 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 425/837] 10.222.0.39 () {60 vars in 1277 bytes} [Thu May 26 12:40:19 2022] POST /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:40:20.051112 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-311f2828-fc50-4aa2-bb38-fe8057417117 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:20.051729 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-311f2828-fc50-4aa2-bb38-fe8057417117 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:20.058423 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-311f2828-fc50-4aa2-bb38-fe8057417117 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:20.058904 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-311f2828-fc50-4aa2-bb38-fe8057417117 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:20.059655 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-311f2828-fc50-4aa2-bb38-fe8057417117 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:20.060339 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-311f2828-fc50-4aa2-bb38-fe8057417117 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:20.225083 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-311f2828-fc50-4aa2-bb38-fe8057417117 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:20.232658 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-311f2828-fc50-4aa2-bb38-fe8057417117 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1661 microversion: 2.1 time: 0.185389 May 26 12:40:20.233251 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 413/838] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:20 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1661 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:21.251859 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-865c686c-3adc-415a-8422-73f3a4536814 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:21.252552 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-865c686c-3adc-415a-8422-73f3a4536814 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:21.259024 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-865c686c-3adc-415a-8422-73f3a4536814 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:21.259472 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-865c686c-3adc-415a-8422-73f3a4536814 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:21.260230 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-865c686c-3adc-415a-8422-73f3a4536814 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:21.260670 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-865c686c-3adc-415a-8422-73f3a4536814 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:21.390973 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-865c686c-3adc-415a-8422-73f3a4536814 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:21.398308 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-865c686c-3adc-415a-8422-73f3a4536814 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1661 microversion: 2.1 time: 0.151180 May 26 12:40:21.399483 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 426/839] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:21 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1661 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:22.416387 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-7769a394-bddb-403d-a967-f188408d1c26 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:22.417018 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-7769a394-bddb-403d-a967-f188408d1c26 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:22.423504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7769a394-bddb-403d-a967-f188408d1c26 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:22.423945 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7769a394-bddb-403d-a967-f188408d1c26 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:22.424694 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7769a394-bddb-403d-a967-f188408d1c26 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:22.425151 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7769a394-bddb-403d-a967-f188408d1c26 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:22.558537 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-7769a394-bddb-403d-a967-f188408d1c26 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:22.566009 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-7769a394-bddb-403d-a967-f188408d1c26 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1665 microversion: 2.1 time: 0.154574 May 26 12:40:22.566575 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 414/840] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:22 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1665 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:27.843204 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-6ec57569-d6de-44ab-b64e-8352dc1faaac tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:27.843736 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-6ec57569-d6de-44ab-b64e-8352dc1faaac tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:27.850192 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6ec57569-d6de-44ab-b64e-8352dc1faaac tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:27.850634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6ec57569-d6de-44ab-b64e-8352dc1faaac tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:27.851385 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6ec57569-d6de-44ab-b64e-8352dc1faaac tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:27.852055 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6ec57569-d6de-44ab-b64e-8352dc1faaac tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:27.933497 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.objects.instance [None req-6ec57569-d6de-44ab-b64e-8352dc1faaac tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lazy-loading 'services' on Instance uuid c221b67a-627a-485b-9790-4de1b4c73aa3 {{(pid=124133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:40:28.009481 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-6ec57569-d6de-44ab-b64e-8352dc1faaac tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3/os-volume_attachments/650941cf-0d0e-4747-b103-539eda008a74" status: 202 len: 0 microversion: 2.1 time: 0.171058 May 26 12:40:28.010080 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 427/841] 10.222.0.39 () {58 vars in 1415 bytes} [Thu May 26 12:40:27 2022] DELETE /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3/os-volume_attachments/650941cf-0d0e-4747-b103-539eda008a74 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:40:28.018784 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-12dc0217-a28d-44b3-8893-d7ae1383d336 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:28.019731 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-12dc0217-a28d-44b3-8893-d7ae1383d336 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:28.026407 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-12dc0217-a28d-44b3-8893-d7ae1383d336 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:28.026943 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-12dc0217-a28d-44b3-8893-d7ae1383d336 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:28.027692 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-12dc0217-a28d-44b3-8893-d7ae1383d336 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:28.028136 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-12dc0217-a28d-44b3-8893-d7ae1383d336 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:28.058762 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-12dc0217-a28d-44b3-8893-d7ae1383d336 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043799 May 26 12:40:28.059250 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 415/842] 10.222.0.39 () {58 vars in 1301 bytes} [Thu May 26 12:40:28 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:40:29.072386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-258101d3-b34d-4400-a925-05882a4b23f4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:29.073506 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-258101d3-b34d-4400-a925-05882a4b23f4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:29.080133 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-258101d3-b34d-4400-a925-05882a4b23f4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:29.080587 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-258101d3-b34d-4400-a925-05882a4b23f4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:29.081408 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-258101d3-b34d-4400-a925-05882a4b23f4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:29.081847 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-258101d3-b34d-4400-a925-05882a4b23f4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:29.111888 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-258101d3-b34d-4400-a925-05882a4b23f4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044308 May 26 12:40:29.112490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 428/843] 10.222.0.39 () {58 vars in 1301 bytes} [Thu May 26 12:40:29 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:40:30.122959 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-975d9926-9790-488b-a7ea-f6368ca23df4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:30.123891 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-975d9926-9790-488b-a7ea-f6368ca23df4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:30.130219 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-975d9926-9790-488b-a7ea-f6368ca23df4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:30.130662 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-975d9926-9790-488b-a7ea-f6368ca23df4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:30.131414 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-975d9926-9790-488b-a7ea-f6368ca23df4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:30.131846 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-975d9926-9790-488b-a7ea-f6368ca23df4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:30.163479 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-975d9926-9790-488b-a7ea-f6368ca23df4 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044385 May 26 12:40:30.163937 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 416/844] 10.222.0.39 () {58 vars in 1301 bytes} [Thu May 26 12:40:30 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:40:30.240149 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ff978559-da26-486d-b034-16bec710dcdb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:30.240706 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ff978559-da26-486d-b034-16bec710dcdb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:30.248808 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ff978559-da26-486d-b034-16bec710dcdb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:30.249265 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ff978559-da26-486d-b034-16bec710dcdb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:30.250039 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ff978559-da26-486d-b034-16bec710dcdb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:30.250478 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ff978559-da26-486d-b034-16bec710dcdb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:30.278043 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ff978559-da26-486d-b034-16bec710dcdb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Going to try to terminate instance {{(pid=124133) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:40:30.356008 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ff978559-da26-486d-b034-16bec710dcdb tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 204 len: 0 microversion: 2.1 time: 0.119579 May 26 12:40:30.357081 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 429/845] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:40:30 2022] DELETE /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:40:30.365602 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-14f27992-b719-4fe7-935d-46cd4143bc1e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:30.366235 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-14f27992-b719-4fe7-935d-46cd4143bc1e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:30.372954 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-14f27992-b719-4fe7-935d-46cd4143bc1e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:30.373403 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-14f27992-b719-4fe7-935d-46cd4143bc1e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:30.374157 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-14f27992-b719-4fe7-935d-46cd4143bc1e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:30.374592 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-14f27992-b719-4fe7-935d-46cd4143bc1e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:30.504256 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-14f27992-b719-4fe7-935d-46cd4143bc1e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:30.511764 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-14f27992-b719-4fe7-935d-46cd4143bc1e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1692 microversion: 2.1 time: 0.150400 May 26 12:40:30.512476 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 417/846] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:30 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1692 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:31.530168 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-2dc20d76-18ec-4417-8b58-bb428c16ffee tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:31.530879 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-2dc20d76-18ec-4417-8b58-bb428c16ffee tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:31.533498 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:31.540416 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2dc20d76-18ec-4417-8b58-bb428c16ffee tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:31.540916 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2dc20d76-18ec-4417-8b58-bb428c16ffee tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:31.541682 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2dc20d76-18ec-4417-8b58-bb428c16ffee tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:31.542122 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2dc20d76-18ec-4417-8b58-bb428c16ffee tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:31.678047 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-2dc20d76-18ec-4417-8b58-bb428c16ffee tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:31.685500 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-2dc20d76-18ec-4417-8b58-bb428c16ffee tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1692 microversion: 2.1 time: 0.159832 May 26 12:40:31.686073 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 430/847] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:31 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:32.702925 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-fec28ce6-2b2c-4441-b2eb-45b4667baa33 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:32.703526 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-fec28ce6-2b2c-4441-b2eb-45b4667baa33 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:32.710127 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fec28ce6-2b2c-4441-b2eb-45b4667baa33 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:32.710574 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fec28ce6-2b2c-4441-b2eb-45b4667baa33 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:32.711460 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fec28ce6-2b2c-4441-b2eb-45b4667baa33 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:32.711813 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fec28ce6-2b2c-4441-b2eb-45b4667baa33 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:32.771026 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-db835598-553b-4ced-abdd-c5955175a808 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:40:32.771591 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-db835598-553b-4ced-abdd-c5955175a808 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:32.778164 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-db835598-553b-4ced-abdd-c5955175a808 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:32.778613 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-db835598-553b-4ced-abdd-c5955175a808 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:32.779379 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-db835598-553b-4ced-abdd-c5955175a808 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:32.779810 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-db835598-553b-4ced-abdd-c5955175a808 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:32.803019 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.objects.instance [None req-db835598-553b-4ced-abdd-c5955175a808 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lazy-loading 'flavor' on Instance uuid a42e497c-0646-4450-9f42-f8da46762273 {{(pid=124133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:40:32.847790 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-fec28ce6-2b2c-4441-b2eb-45b4667baa33 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:32.857027 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-fec28ce6-2b2c-4441-b2eb-45b4667baa33 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1692 microversion: 2.1 time: 0.157862 May 26 12:40:32.857608 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 418/848] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:32 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:32.876133 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-db835598-553b-4ced-abdd-c5955175a808 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "POST /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273/action" status: 202 len: 0 microversion: 2.1 time: 0.108826 May 26 12:40:32.876705 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 431/849] 10.222.0.39 () {60 vars in 1277 bytes} [Thu May 26 12:40:32 2022] POST /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 12:40:32.885431 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-0cce809d-fdb6-4cc9-983a-320620fe7f4c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:32.886132 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-0cce809d-fdb6-4cc9-983a-320620fe7f4c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:32.892481 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0cce809d-fdb6-4cc9-983a-320620fe7f4c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:32.892965 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0cce809d-fdb6-4cc9-983a-320620fe7f4c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:32.893724 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0cce809d-fdb6-4cc9-983a-320620fe7f4c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:32.894156 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0cce809d-fdb6-4cc9-983a-320620fe7f4c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:33.028008 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-0cce809d-fdb6-4cc9-983a-320620fe7f4c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:33.035495 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-0cce809d-fdb6-4cc9-983a-320620fe7f4c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1570 microversion: 2.1 time: 0.154404 May 26 12:40:33.036051 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 419/850] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:32 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:33.875527 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-a428da1a-6d34-4f1c-a89b-83b2519e354c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:33.876216 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-a428da1a-6d34-4f1c-a89b-83b2519e354c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:33.882544 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a428da1a-6d34-4f1c-a89b-83b2519e354c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:33.883614 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a428da1a-6d34-4f1c-a89b-83b2519e354c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:33.884596 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a428da1a-6d34-4f1c-a89b-83b2519e354c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:33.885055 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a428da1a-6d34-4f1c-a89b-83b2519e354c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:33.900522 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:34.021655 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-a428da1a-6d34-4f1c-a89b-83b2519e354c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:34.029423 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-a428da1a-6d34-4f1c-a89b-83b2519e354c tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1692 microversion: 2.1 time: 0.158684 May 26 12:40:34.029986 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 432/851] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:33 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:34.053285 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b5490151-5ef7-4efc-9ee3-c35238092066 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:34.053835 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b5490151-5ef7-4efc-9ee3-c35238092066 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:34.056878 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=46 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:34.062284 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b5490151-5ef7-4efc-9ee3-c35238092066 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:34.062718 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b5490151-5ef7-4efc-9ee3-c35238092066 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:34.063482 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b5490151-5ef7-4efc-9ee3-c35238092066 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:34.063926 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b5490151-5ef7-4efc-9ee3-c35238092066 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:34.194870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b5490151-5ef7-4efc-9ee3-c35238092066 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:34.203451 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b5490151-5ef7-4efc-9ee3-c35238092066 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1570 microversion: 2.1 time: 0.153912 May 26 12:40:34.204082 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 420/852] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:34 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:35.046419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-84e277f4-7380-493b-adee-5877a9c6df05 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:35.047055 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-84e277f4-7380-493b-adee-5877a9c6df05 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:35.053483 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-84e277f4-7380-493b-adee-5877a9c6df05 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:35.053937 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-84e277f4-7380-493b-adee-5877a9c6df05 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:35.054780 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-84e277f4-7380-493b-adee-5877a9c6df05 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:35.055262 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-84e277f4-7380-493b-adee-5877a9c6df05 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:35.221466 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b21692f6-9d85-4ac7-9ed6-b578cfbcbaa4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:35.222119 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b21692f6-9d85-4ac7-9ed6-b578cfbcbaa4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:35.229758 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b21692f6-9d85-4ac7-9ed6-b578cfbcbaa4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:35.230215 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b21692f6-9d85-4ac7-9ed6-b578cfbcbaa4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:35.231930 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b21692f6-9d85-4ac7-9ed6-b578cfbcbaa4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:35.232394 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b21692f6-9d85-4ac7-9ed6-b578cfbcbaa4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:35.238321 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=100 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:35.602054 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-84e277f4-7380-493b-adee-5877a9c6df05 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:35.609776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-84e277f4-7380-493b-adee-5877a9c6df05 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1692 microversion: 2.1 time: 0.567290 May 26 12:40:35.610345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 433/853] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:35 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1692 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:35.620657 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b21692f6-9d85-4ac7-9ed6-b578cfbcbaa4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:35.628356 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b21692f6-9d85-4ac7-9ed6-b578cfbcbaa4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1570 microversion: 2.1 time: 0.410923 May 26 12:40:35.628964 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 421/854] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:35 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1570 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:40:36.013938 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-88a2fee6-1c60-4abb-ae0f-88388a69c917 req-34d73ef0-7569-4dc3-a8e4-9da7c050566f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c221b67a-627a-485b-9790-4de1b4c73aa3", "name": "network-vif-deleted", "tag": "ae3caa21-abd3-4200-9c1d-7ce93b0d6e74"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:40:36.022267 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-88a2fee6-1c60-4abb-ae0f-88388a69c917 req-34d73ef0-7569-4dc3-a8e4-9da7c050566f service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:36.022716 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-88a2fee6-1c60-4abb-ae0f-88388a69c917 req-34d73ef0-7569-4dc3-a8e4-9da7c050566f service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:36.034473 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-88a2fee6-1c60-4abb-ae0f-88388a69c917 req-34d73ef0-7569-4dc3-a8e4-9da7c050566f service nova] Creating event network-vif-deleted:ae3caa21-abd3-4200-9c1d-7ce93b0d6e74 for instance c221b67a-627a-485b-9790-4de1b4c73aa3 on hv-cinder-81514 May 26 12:40:36.039263 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-88a2fee6-1c60-4abb-ae0f-88388a69c917 req-34d73ef0-7569-4dc3-a8e4-9da7c050566f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029098 May 26 12:40:36.040193 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 434/855] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:40:36.627334 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-aca70277-6f60-4931-bb00-9269be741e54 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:36.627982 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-aca70277-6f60-4931-bb00-9269be741e54 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:36.634981 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-aca70277-6f60-4931-bb00-9269be741e54 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:36.635443 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-aca70277-6f60-4931-bb00-9269be741e54 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:36.636240 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-aca70277-6f60-4931-bb00-9269be741e54 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:36.636675 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-aca70277-6f60-4931-bb00-9269be741e54 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:36.645887 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-396c0188-1143-466a-ae72-bf9507dc33e0 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:36.646402 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-396c0188-1143-466a-ae72-bf9507dc33e0 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:36.653350 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-396c0188-1143-466a-ae72-bf9507dc33e0 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:36.654022 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-396c0188-1143-466a-ae72-bf9507dc33e0 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:36.654964 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-396c0188-1143-466a-ae72-bf9507dc33e0 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:36.655412 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-396c0188-1143-466a-ae72-bf9507dc33e0 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:36.683534 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-aca70277-6f60-4931-bb00-9269be741e54 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:36.683982 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-aca70277-6f60-4931-bb00-9269be741e54 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:36.684707 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.objects.instance [None req-aca70277-6f60-4931-bb00-9269be741e54 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lazy-loading 'fault' on Instance uuid c221b67a-627a-485b-9790-4de1b4c73aa3 {{(pid=124134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:40:36.770163 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-aca70277-6f60-4931-bb00-9269be741e54 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:36.779184 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-aca70277-6f60-4931-bb00-9269be741e54 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 200 len: 1336 microversion: 2.1 time: 0.155829 May 26 12:40:36.780263 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 422/856] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:36 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 1336 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:36.834508 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-396c0188-1143-466a-ae72-bf9507dc33e0 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:36.843248 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-396c0188-1143-466a-ae72-bf9507dc33e0 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1570 microversion: 2.1 time: 0.201761 May 26 12:40:36.843818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 435/857] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:36 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1570 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:40:37.796257 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-aaed0e88-e2cd-437b-991e-09b701302a60 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:37.796889 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-aaed0e88-e2cd-437b-991e-09b701302a60 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: c221b67a-627a-485b-9790-4de1b4c73aa3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:37.803332 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-aaed0e88-e2cd-437b-991e-09b701302a60 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:37.803775 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-aaed0e88-e2cd-437b-991e-09b701302a60 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:37.804521 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-aaed0e88-e2cd-437b-991e-09b701302a60 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:37.804996 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-aaed0e88-e2cd-437b-991e-09b701302a60 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:37.818495 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.wsgi [None req-aaed0e88-e2cd-437b-991e-09b701302a60 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] HTTP exception thrown: Instance c221b67a-627a-485b-9790-4de1b4c73aa3 could not be found. May 26 12:40:37.820216 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-aaed0e88-e2cd-437b-991e-09b701302a60 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Request method failure captured: May 26 12:40:37.820216 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: request: GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 HTTP/1.1 May 26 12:40:37.820216 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept: application/json May 26 12:40:37.820216 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept-Encoding: identity May 26 12:40:37.820216 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Connection: close May 26 12:40:37.820216 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Length: 0 May 26 12:40:37.820216 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Type: application/json May 26 12:40:37.820216 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Host: 10.222.0.39 May 26 12:40:37.820216 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Openstack-System-Scope: None May 26 12:40:37.820216 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: User-Agent: python-urllib3/1.26.9 May 26 12:40:37.820216 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Auth-Token: gAAAAABij3Ntqo6mdEJ8LlroeinMz0Ovwgkcu2R0zXHjrqQCwq-qJ6oPcC8FCHT3hC1bdixJrdJYoCLHstLf6akw5UN-MphCul9GtSUwf9FwmTUfFUAxs8HgSg_WfADTM9Joom-FI-Cefk6wDfus-Tadb14JEb56PeYzGrxEpIbsZQQAobngoa8 May 26 12:40:37.820216 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Id: None May 26 12:40:37.820216 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Name: None May 26 12:40:37.820216 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Identity-Status: Confirmed May 26 12:40:37.820216 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Is-Admin-Project: True May 26 12:40:37.820216 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Id: default May 26 12:40:37.820216 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Name: Default May 26 12:40:37.820216 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Id: d04d37bf7dfc47f3b20a58a3d95c1c2b May 26 12:40:37.820216 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1556240871 May 26 12:40:37.820216 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Role: member,reader May 26 12:40:37.820216 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Roles: member,reader May 26 12:40:37.821723 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d04d37bf7dfc47f3b20a58a3d95c1c2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d04d37bf7dfc47f3b20a58a3d95c1c2b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d04d37bf7dfc47f3b20a58a3d95c1c2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d04d37bf7dfc47f3b20a58a3d95c1c2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:40:37.821723 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1556240871 May 26 12:40:37.821723 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Id: d04d37bf7dfc47f3b20a58a3d95c1c2b May 26 12:40:37.821723 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1556240871 May 26 12:40:37.821723 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User: tempest-ServerRescueNegativeTestJSON-1556240871-project May 26 12:40:37.821723 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Id: default May 26 12:40:37.821723 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Name: Default May 26 12:40:37.821723 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Id: c21602eca99d48d8824c0f5c1693d573 May 26 12:40:37.821723 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1556240871-project May 26 12:40:37.821723 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: method: > May 26 12:40:37.821723 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: exception: Instance c221b67a-627a-485b-9790-4de1b4c73aa3 could not be found. May 26 12:40:37.821723 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: action_args: {'id': 'c221b67a-627a-485b-9790-4de1b4c73aa3'} May 26 12:40:37.822504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:40:37.822504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:40:37.822504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:40:37.822504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:40:37.822504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:40:37.822504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:40:37.822504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:40:37.822504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:40:37.822504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:40:37.822504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:40:37.822504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c221b67a-627a-485b-9790-4de1b4c73aa3 could not be found. May 26 12:40:37.822504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:40:37.822504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:40:37.822504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:40:37.822504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:40:37.822504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:40:37.822504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:40:37.822504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:40:37.822504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:40:37.822504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:40:37.823913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:40:37.823913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:40:37.823913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:40:37.823913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:40:37.823913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:40:37.823913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:40:37.823913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:40:37.823913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c221b67a-627a-485b-9790-4de1b4c73aa3 could not be found. May 26 12:40:37.823913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:40:37.823913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:40:37.823913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:40:37.823913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:40:37.823913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:40:37.823913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:40:37.823913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:40:37.823913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:40:37.823913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c221b67a-627a-485b-9790-4de1b4c73aa3 could not be found. May 26 12:40:37.823913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:40:37.825875 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-aaed0e88-e2cd-437b-991e-09b701302a60 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Returning 404 to user: Instance c221b67a-627a-485b-9790-4de1b4c73aa3 could not be found. {{(pid=124134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:40:37.825875 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-aaed0e88-e2cd-437b-991e-09b701302a60 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3" status: 404 len: 111 microversion: 2.1 time: 0.029334 May 26 12:40:37.825875 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 423/858] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:37 2022] GET /compute/v2.1/servers/c221b67a-627a-485b-9790-4de1b4c73aa3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:40:37.830871 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-4d455115-cbc8-4341-95aa-90ea4fc0b65e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '.version_select at 0x7fed31539040>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:37.849515 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-4d455115-cbc8-4341-95aa-90ea4fc0b65e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1329056989" status: 202 len: 0 microversion: 2.1 time: 0.022879 May 26 12:40:37.850084 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 436/859] 10.222.0.39 () {58 vars in 1220 bytes} [Thu May 26 12:40:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1329056989 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 12:40:37.861041 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-ce93ed93-a0e4-4b83-a240-32457dd79732 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:37.861656 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-ce93ed93-a0e4-4b83-a240-32457dd79732 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:37.867883 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ce93ed93-a0e4-4b83-a240-32457dd79732 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:37.868338 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ce93ed93-a0e4-4b83-a240-32457dd79732 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:37.869141 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ce93ed93-a0e4-4b83-a240-32457dd79732 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:37.869587 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ce93ed93-a0e4-4b83-a240-32457dd79732 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:38.056246 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ce93ed93-a0e4-4b83-a240-32457dd79732 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:38.065432 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-ce93ed93-a0e4-4b83-a240-32457dd79732 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1570 microversion: 2.1 time: 0.208547 May 26 12:40:38.065432 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 424/860] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:37 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1570 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:39.083185 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-1dadf4d0-8117-4574-81bc-76fcdcdb5cae tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:39.083809 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-1dadf4d0-8117-4574-81bc-76fcdcdb5cae tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:39.090890 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1dadf4d0-8117-4574-81bc-76fcdcdb5cae tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:39.091349 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1dadf4d0-8117-4574-81bc-76fcdcdb5cae tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:39.092114 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1dadf4d0-8117-4574-81bc-76fcdcdb5cae tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:39.092548 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1dadf4d0-8117-4574-81bc-76fcdcdb5cae tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:39.225274 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-1dadf4d0-8117-4574-81bc-76fcdcdb5cae tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:39.233007 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-1dadf4d0-8117-4574-81bc-76fcdcdb5cae tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1570 microversion: 2.1 time: 0.154110 May 26 12:40:39.233571 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 437/861] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:39 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:40:40.250345 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-ed19f8b1-4484-4732-9a00-6e010175230b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:40.250959 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-ed19f8b1-4484-4732-9a00-6e010175230b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:40.257547 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ed19f8b1-4484-4732-9a00-6e010175230b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:40.257993 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ed19f8b1-4484-4732-9a00-6e010175230b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:40.258748 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ed19f8b1-4484-4732-9a00-6e010175230b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:40.259740 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ed19f8b1-4484-4732-9a00-6e010175230b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:40.393366 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ed19f8b1-4484-4732-9a00-6e010175230b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:40.401573 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-ed19f8b1-4484-4732-9a00-6e010175230b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1570 microversion: 2.1 time: 0.155157 May 26 12:40:40.402131 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 425/862] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:40 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:40.793634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-62a3cdef-b4f5-474e-9e13-73b38b9ad18b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:40.794144 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-62a3cdef-b4f5-474e-9e13-73b38b9ad18b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:40.801052 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-62a3cdef-b4f5-474e-9e13-73b38b9ad18b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:40.801506 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-62a3cdef-b4f5-474e-9e13-73b38b9ad18b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:40.802374 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-62a3cdef-b4f5-474e-9e13-73b38b9ad18b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:40.802831 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-62a3cdef-b4f5-474e-9e13-73b38b9ad18b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:40.841155 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-62a3cdef-b4f5-474e-9e13-73b38b9ad18b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Going to try to terminate instance {{(pid=124133) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:40:40.925472 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-62a3cdef-b4f5-474e-9e13-73b38b9ad18b tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 204 len: 0 microversion: 2.1 time: 0.135700 May 26 12:40:40.926053 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 438/863] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:40:40 2022] DELETE /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:40:40.936177 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6735fa3d-6247-4330-bd50-73b6a09d65de tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:40.936812 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-6735fa3d-6247-4330-bd50-73b6a09d65de tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:40.942890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6735fa3d-6247-4330-bd50-73b6a09d65de tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:40.943335 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6735fa3d-6247-4330-bd50-73b6a09d65de tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:40.944091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6735fa3d-6247-4330-bd50-73b6a09d65de tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:40.944578 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6735fa3d-6247-4330-bd50-73b6a09d65de tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:41.075294 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-6735fa3d-6247-4330-bd50-73b6a09d65de tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:41.082632 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-6735fa3d-6247-4330-bd50-73b6a09d65de tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1508 microversion: 2.1 time: 0.152521 May 26 12:40:41.083201 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 426/864] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:40 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:41.419966 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-46c86b4f-ab88-45e4-aa0e-f3d4332d982a tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:41.420669 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-46c86b4f-ab88-45e4-aa0e-f3d4332d982a tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:41.427727 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-46c86b4f-ab88-45e4-aa0e-f3d4332d982a tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:41.428180 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-46c86b4f-ab88-45e4-aa0e-f3d4332d982a tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:41.428981 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-46c86b4f-ab88-45e4-aa0e-f3d4332d982a tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:41.429419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-46c86b4f-ab88-45e4-aa0e-f3d4332d982a tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:41.573972 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-46c86b4f-ab88-45e4-aa0e-f3d4332d982a tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:41.584450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-46c86b4f-ab88-45e4-aa0e-f3d4332d982a tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1570 microversion: 2.1 time: 0.169101 May 26 12:40:41.585394 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 439/865] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:41 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:42.099375 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-286e5be0-be9d-4f14-8853-532c1b745134 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:42.100022 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-286e5be0-be9d-4f14-8853-532c1b745134 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:42.106717 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-286e5be0-be9d-4f14-8853-532c1b745134 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:42.107170 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-286e5be0-be9d-4f14-8853-532c1b745134 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:42.107937 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-286e5be0-be9d-4f14-8853-532c1b745134 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:42.108391 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-286e5be0-be9d-4f14-8853-532c1b745134 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:42.324640 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-286e5be0-be9d-4f14-8853-532c1b745134 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:42.332240 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-286e5be0-be9d-4f14-8853-532c1b745134 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 200 len: 1508 microversion: 2.1 time: 0.236732 May 26 12:40:42.332922 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 427/866] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:42 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 1508 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:42.484197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-57e1e6c6-bb12-4010-b803-b1247b4a1645 req-d21dbbad-f3c3-4f81-957c-7e51cd8a4803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff659e6a-5e2b-45d6-84d5-360c22ccc03e", "name": "network-vif-deleted", "tag": "ce7102b2-644a-427b-bd62-1d31c3727bcb"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:40:42.501534 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-57e1e6c6-bb12-4010-b803-b1247b4a1645 req-d21dbbad-f3c3-4f81-957c-7e51cd8a4803 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:42.502089 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-57e1e6c6-bb12-4010-b803-b1247b4a1645 req-d21dbbad-f3c3-4f81-957c-7e51cd8a4803 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:42.515603 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-57e1e6c6-bb12-4010-b803-b1247b4a1645 req-d21dbbad-f3c3-4f81-957c-7e51cd8a4803 service nova] Creating event network-vif-deleted:ce7102b2-644a-427b-bd62-1d31c3727bcb for instance ff659e6a-5e2b-45d6-84d5-360c22ccc03e on hv-cinder-81514 May 26 12:40:42.520919 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-57e1e6c6-bb12-4010-b803-b1247b4a1645 req-d21dbbad-f3c3-4f81-957c-7e51cd8a4803 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040121 May 26 12:40:42.521917 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 440/867] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:40:42.603572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-d39e2c73-9e8a-46ec-8c4e-ed6b31861f87 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:42.604371 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-d39e2c73-9e8a-46ec-8c4e-ed6b31861f87 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:42.610371 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d39e2c73-9e8a-46ec-8c4e-ed6b31861f87 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:42.610817 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d39e2c73-9e8a-46ec-8c4e-ed6b31861f87 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:42.611569 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d39e2c73-9e8a-46ec-8c4e-ed6b31861f87 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:42.612001 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d39e2c73-9e8a-46ec-8c4e-ed6b31861f87 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:42.754082 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d39e2c73-9e8a-46ec-8c4e-ed6b31861f87 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:42.762044 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-d39e2c73-9e8a-46ec-8c4e-ed6b31861f87 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1570 microversion: 2.1 time: 0.162977 May 26 12:40:42.762630 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 428/868] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:42 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:43.350830 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-088570ab-2002-4fc4-b909-6a80d2d71f05 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:43.351433 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-088570ab-2002-4fc4-b909-6a80d2d71f05 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: ff659e6a-5e2b-45d6-84d5-360c22ccc03e] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:43.358005 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-088570ab-2002-4fc4-b909-6a80d2d71f05 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:43.358458 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-088570ab-2002-4fc4-b909-6a80d2d71f05 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:43.359214 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-088570ab-2002-4fc4-b909-6a80d2d71f05 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:43.359653 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-088570ab-2002-4fc4-b909-6a80d2d71f05 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:43.373694 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-088570ab-2002-4fc4-b909-6a80d2d71f05 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] HTTP exception thrown: Instance ff659e6a-5e2b-45d6-84d5-360c22ccc03e could not be found. May 26 12:40:43.375302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-088570ab-2002-4fc4-b909-6a80d2d71f05 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Request method failure captured: May 26 12:40:43.375302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e HTTP/1.1 May 26 12:40:43.375302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:40:43.375302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:40:43.375302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:40:43.375302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:40:43.375302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:40:43.375302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:40:43.375302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:40:43.375302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:40:43.375302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3Ntqo6mdEJ8LlroeinMz0Ovwgkcu2R0zXHjrqQCwq-qJ6oPcC8FCHT3hC1bdixJrdJYoCLHstLf6akw5UN-MphCul9GtSUwf9FwmTUfFUAxs8HgSg_WfADTM9Joom-FI-Cefk6wDfus-Tadb14JEb56PeYzGrxEpIbsZQQAobngoa8 May 26 12:40:43.375302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:40:43.375302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:40:43.375302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:40:43.375302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:40:43.375302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:40:43.375302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:40:43.375302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: d04d37bf7dfc47f3b20a58a3d95c1c2b May 26 12:40:43.375302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1556240871 May 26 12:40:43.375302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:40:43.375302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:40:43.376640 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d04d37bf7dfc47f3b20a58a3d95c1c2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d04d37bf7dfc47f3b20a58a3d95c1c2b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d04d37bf7dfc47f3b20a58a3d95c1c2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d04d37bf7dfc47f3b20a58a3d95c1c2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:40:43.376640 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1556240871 May 26 12:40:43.376640 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: d04d37bf7dfc47f3b20a58a3d95c1c2b May 26 12:40:43.376640 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1556240871 May 26 12:40:43.376640 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-ServerRescueNegativeTestJSON-1556240871-project May 26 12:40:43.376640 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:40:43.376640 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:40:43.376640 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: c21602eca99d48d8824c0f5c1693d573 May 26 12:40:43.376640 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1556240871-project May 26 12:40:43.376640 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: > May 26 12:40:43.376640 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Instance ff659e6a-5e2b-45d6-84d5-360c22ccc03e could not be found. May 26 12:40:43.376640 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': 'ff659e6a-5e2b-45d6-84d5-360c22ccc03e'} May 26 12:40:43.377450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:40:43.377450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:40:43.377450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:40:43.377450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:40:43.377450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:40:43.377450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:40:43.377450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:40:43.377450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:40:43.377450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:40:43.377450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:40:43.377450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff659e6a-5e2b-45d6-84d5-360c22ccc03e could not be found. May 26 12:40:43.377450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:40:43.377450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:40:43.377450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:40:43.377450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:40:43.377450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:40:43.377450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:40:43.377450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:40:43.377450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:40:43.377450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:40:43.378740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:40:43.378740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:40:43.378740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:40:43.378740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:40:43.378740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:40:43.378740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:40:43.378740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:40:43.378740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff659e6a-5e2b-45d6-84d5-360c22ccc03e could not be found. May 26 12:40:43.378740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:40:43.378740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:40:43.378740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:40:43.378740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:40:43.378740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:40:43.378740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:40:43.378740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:40:43.378740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:40:43.378740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff659e6a-5e2b-45d6-84d5-360c22ccc03e could not be found. May 26 12:40:43.378740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:40:43.380707 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-088570ab-2002-4fc4-b909-6a80d2d71f05 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Returning 404 to user: Instance ff659e6a-5e2b-45d6-84d5-360c22ccc03e could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:40:43.380707 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-088570ab-2002-4fc4-b909-6a80d2d71f05 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e" status: 404 len: 111 microversion: 2.1 time: 0.031380 May 26 12:40:43.380707 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 441/869] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:43 2022] GET /compute/v2.1/servers/ff659e6a-5e2b-45d6-84d5-360c22ccc03e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:40:43.386591 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-4a2a73d5-58e9-4d7f-ae10-c65019558efc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:43.387085 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-4a2a73d5-58e9-4d7f-ae10-c65019558efc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:43.393798 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4a2a73d5-58e9-4d7f-ae10-c65019558efc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:43.394238 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4a2a73d5-58e9-4d7f-ae10-c65019558efc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:43.394990 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4a2a73d5-58e9-4d7f-ae10-c65019558efc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:43.395421 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4a2a73d5-58e9-4d7f-ae10-c65019558efc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:43.420843 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-4a2a73d5-58e9-4d7f-ae10-c65019558efc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Going to try to terminate instance {{(pid=124134) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:40:43.506565 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-4a2a73d5-58e9-4d7f-ae10-c65019558efc tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "DELETE /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 204 len: 0 microversion: 2.1 time: 0.124161 May 26 12:40:43.507330 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 429/870] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:40:43 2022] DELETE /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 12:40:43.517518 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-c2543494-0960-4c0b-a639-08c233d3fbc9 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:43.518286 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-c2543494-0960-4c0b-a639-08c233d3fbc9 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:43.526294 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c2543494-0960-4c0b-a639-08c233d3fbc9 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:43.526900 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c2543494-0960-4c0b-a639-08c233d3fbc9 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:43.527783 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c2543494-0960-4c0b-a639-08c233d3fbc9 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:43.528326 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c2543494-0960-4c0b-a639-08c233d3fbc9 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:43.657828 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-c2543494-0960-4c0b-a639-08c233d3fbc9 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:43.665381 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-c2543494-0960-4c0b-a639-08c233d3fbc9 tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1523 microversion: 2.1 time: 0.153109 May 26 12:40:43.665940 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 442/871] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:43 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:43.779827 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-3efb6d1e-fa9c-46d6-9da2-9a13addb85d4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:43.780520 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-3efb6d1e-fa9c-46d6-9da2-9a13addb85d4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:43.786499 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3efb6d1e-fa9c-46d6-9da2-9a13addb85d4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:43.787013 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3efb6d1e-fa9c-46d6-9da2-9a13addb85d4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:43.787767 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3efb6d1e-fa9c-46d6-9da2-9a13addb85d4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:43.788198 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3efb6d1e-fa9c-46d6-9da2-9a13addb85d4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:43.923633 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-3efb6d1e-fa9c-46d6-9da2-9a13addb85d4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:43.932058 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-3efb6d1e-fa9c-46d6-9da2-9a13addb85d4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1570 microversion: 2.1 time: 0.155474 May 26 12:40:43.932764 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 430/872] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:43 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:44.685088 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ad9d4448-a781-4e3b-a4cb-a153bda35e2e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:44.685852 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ad9d4448-a781-4e3b-a4cb-a153bda35e2e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:44.693387 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ad9d4448-a781-4e3b-a4cb-a153bda35e2e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:44.693927 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ad9d4448-a781-4e3b-a4cb-a153bda35e2e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:44.694941 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ad9d4448-a781-4e3b-a4cb-a153bda35e2e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:44.695501 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ad9d4448-a781-4e3b-a4cb-a153bda35e2e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:44.836124 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ad9d4448-a781-4e3b-a4cb-a153bda35e2e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:44.844214 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ad9d4448-a781-4e3b-a4cb-a153bda35e2e tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1523 microversion: 2.1 time: 0.165453 May 26 12:40:44.844798 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 443/873] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:44 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:44.948921 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b3e86e2b-d4a4-442f-b884-f7b64139f2e0 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:44.949474 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b3e86e2b-d4a4-442f-b884-f7b64139f2e0 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:44.955932 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b3e86e2b-d4a4-442f-b884-f7b64139f2e0 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:44.956384 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b3e86e2b-d4a4-442f-b884-f7b64139f2e0 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:44.957170 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b3e86e2b-d4a4-442f-b884-f7b64139f2e0 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:44.957607 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b3e86e2b-d4a4-442f-b884-f7b64139f2e0 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:45.086691 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b3e86e2b-d4a4-442f-b884-f7b64139f2e0 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:45.095679 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b3e86e2b-d4a4-442f-b884-f7b64139f2e0 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1570 microversion: 2.1 time: 0.151248 May 26 12:40:45.096345 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 431/874] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:44 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:45.862417 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-8e19326a-b595-4500-ae98-73777ea2c1bf tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:45.863292 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-8e19326a-b595-4500-ae98-73777ea2c1bf tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:45.871416 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8e19326a-b595-4500-ae98-73777ea2c1bf tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:45.872092 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8e19326a-b595-4500-ae98-73777ea2c1bf tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:45.873084 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8e19326a-b595-4500-ae98-73777ea2c1bf tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:45.873729 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8e19326a-b595-4500-ae98-73777ea2c1bf tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:45.929729 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-8243078d-1184-4ed6-ae8b-d9ab210b06de req-09884f71-e792-4a92-96a7-07a8d36cc3ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131042dc-6807-4136-b6ed-7aead934b6b2", "name": "network-vif-deleted", "tag": "bab2b455-3763-41f4-abad-0835ee7f958f"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:40:45.942099 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-8243078d-1184-4ed6-ae8b-d9ab210b06de req-09884f71-e792-4a92-96a7-07a8d36cc3ba service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:45.942543 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-8243078d-1184-4ed6-ae8b-d9ab210b06de req-09884f71-e792-4a92-96a7-07a8d36cc3ba service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:45.954393 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-8e19326a-b595-4500-ae98-73777ea2c1bf tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21602eca99d48d8824c0f5c1693d573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:45.955075 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-8243078d-1184-4ed6-ae8b-d9ab210b06de req-09884f71-e792-4a92-96a7-07a8d36cc3ba service nova] Creating event network-vif-deleted:bab2b455-3763-41f4-abad-0835ee7f958f for instance 131042dc-6807-4136-b6ed-7aead934b6b2 on hv-cinder-81514 May 26 12:40:45.961000 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-8243078d-1184-4ed6-ae8b-d9ab210b06de req-09884f71-e792-4a92-96a7-07a8d36cc3ba service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036792 May 26 12:40:45.961625 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 432/875] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:40:45.964599 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-8e19326a-b595-4500-ae98-73777ea2c1bf tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 200 len: 1481 microversion: 2.1 time: 0.107558 May 26 12:40:45.965268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 444/876] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:45 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 1481 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:46.114181 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e89c9e4e-3d47-4b3a-895b-ecc871daaa48 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:46.114793 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-e89c9e4e-3d47-4b3a-895b-ecc871daaa48 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:46.121408 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e89c9e4e-3d47-4b3a-895b-ecc871daaa48 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:46.121862 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e89c9e4e-3d47-4b3a-895b-ecc871daaa48 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:46.122626 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e89c9e4e-3d47-4b3a-895b-ecc871daaa48 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:46.123063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e89c9e4e-3d47-4b3a-895b-ecc871daaa48 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:46.271683 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-e89c9e4e-3d47-4b3a-895b-ecc871daaa48 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:46.282068 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-e89c9e4e-3d47-4b3a-895b-ecc871daaa48 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1570 microversion: 2.1 time: 0.172086 May 26 12:40:46.283058 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 433/877] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:46 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:46.982955 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-db3e0bef-d7b4-4ea1-a26f-b2718de7799d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:46.983567 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-db3e0bef-d7b4-4ea1-a26f-b2718de7799d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] [instance: 131042dc-6807-4136-b6ed-7aead934b6b2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:46.990424 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-db3e0bef-d7b4-4ea1-a26f-b2718de7799d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:46.990886 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-db3e0bef-d7b4-4ea1-a26f-b2718de7799d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:46.991645 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-db3e0bef-d7b4-4ea1-a26f-b2718de7799d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:46.992085 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-db3e0bef-d7b4-4ea1-a26f-b2718de7799d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:47.005805 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-db3e0bef-d7b4-4ea1-a26f-b2718de7799d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] HTTP exception thrown: Instance 131042dc-6807-4136-b6ed-7aead934b6b2 could not be found. May 26 12:40:47.007315 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-db3e0bef-d7b4-4ea1-a26f-b2718de7799d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Request method failure captured: May 26 12:40:47.007315 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 HTTP/1.1 May 26 12:40:47.007315 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:40:47.007315 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:40:47.007315 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:40:47.007315 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:40:47.007315 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:40:47.007315 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:40:47.007315 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:40:47.007315 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:40:47.007315 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3Ntqo6mdEJ8LlroeinMz0Ovwgkcu2R0zXHjrqQCwq-qJ6oPcC8FCHT3hC1bdixJrdJYoCLHstLf6akw5UN-MphCul9GtSUwf9FwmTUfFUAxs8HgSg_WfADTM9Joom-FI-Cefk6wDfus-Tadb14JEb56PeYzGrxEpIbsZQQAobngoa8 May 26 12:40:47.007315 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:40:47.007315 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:40:47.007315 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:40:47.007315 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:40:47.007315 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:40:47.007315 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:40:47.007315 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: d04d37bf7dfc47f3b20a58a3d95c1c2b May 26 12:40:47.007315 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1556240871 May 26 12:40:47.007315 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:40:47.007315 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:40:47.008899 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d04d37bf7dfc47f3b20a58a3d95c1c2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d04d37bf7dfc47f3b20a58a3d95c1c2b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d04d37bf7dfc47f3b20a58a3d95c1c2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d04d37bf7dfc47f3b20a58a3d95c1c2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:40:47.008899 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1556240871 May 26 12:40:47.008899 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: d04d37bf7dfc47f3b20a58a3d95c1c2b May 26 12:40:47.008899 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1556240871 May 26 12:40:47.008899 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-ServerRescueNegativeTestJSON-1556240871-project May 26 12:40:47.008899 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:40:47.008899 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:40:47.008899 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: c21602eca99d48d8824c0f5c1693d573 May 26 12:40:47.008899 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1556240871-project May 26 12:40:47.008899 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: > May 26 12:40:47.008899 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Instance 131042dc-6807-4136-b6ed-7aead934b6b2 could not be found. May 26 12:40:47.008899 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': '131042dc-6807-4136-b6ed-7aead934b6b2'} May 26 12:40:47.009825 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:40:47.009825 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:40:47.009825 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:40:47.009825 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:40:47.009825 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:40:47.009825 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:40:47.009825 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:40:47.009825 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:40:47.009825 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:40:47.009825 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:40:47.009825 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 131042dc-6807-4136-b6ed-7aead934b6b2 could not be found. May 26 12:40:47.009825 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:40:47.009825 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:40:47.009825 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:40:47.009825 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:40:47.009825 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:40:47.009825 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:40:47.009825 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:40:47.009825 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:40:47.009825 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:40:47.011789 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:40:47.011789 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:40:47.011789 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:40:47.011789 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:40:47.011789 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:40:47.011789 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:40:47.011789 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:40:47.011789 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 131042dc-6807-4136-b6ed-7aead934b6b2 could not be found. May 26 12:40:47.011789 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:40:47.011789 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:40:47.011789 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:40:47.011789 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:40:47.011789 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:40:47.011789 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:40:47.011789 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:40:47.011789 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:40:47.011789 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 131042dc-6807-4136-b6ed-7aead934b6b2 could not be found. May 26 12:40:47.011789 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:40:47.013723 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-db3e0bef-d7b4-4ea1-a26f-b2718de7799d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] Returning 404 to user: Instance 131042dc-6807-4136-b6ed-7aead934b6b2 could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:40:47.013723 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-db3e0bef-d7b4-4ea1-a26f-b2718de7799d tempest-ServerRescueNegativeTestJSON-1556240871 tempest-ServerRescueNegativeTestJSON-1556240871-project] 10.222.0.39 "GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2" status: 404 len: 111 microversion: 2.1 time: 0.030291 May 26 12:40:47.013723 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 445/878] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:46 2022] GET /compute/v2.1/servers/131042dc-6807-4136-b6ed-7aead934b6b2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:40:47.299637 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-3df8682f-14d1-4e1f-9dd8-cd455a897ddf tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:47.300252 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-3df8682f-14d1-4e1f-9dd8-cd455a897ddf tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:47.306770 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3df8682f-14d1-4e1f-9dd8-cd455a897ddf tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:47.307227 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3df8682f-14d1-4e1f-9dd8-cd455a897ddf tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:47.307990 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3df8682f-14d1-4e1f-9dd8-cd455a897ddf tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:47.308431 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3df8682f-14d1-4e1f-9dd8-cd455a897ddf tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:47.442074 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-3df8682f-14d1-4e1f-9dd8-cd455a897ddf tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:47.451214 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-3df8682f-14d1-4e1f-9dd8-cd455a897ddf tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1570 microversion: 2.1 time: 0.155370 May 26 12:40:47.451884 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 434/879] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:47 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:48.471516 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-84bea49b-2c15-4318-8aa0-3679d0035967 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:48.472839 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-84bea49b-2c15-4318-8aa0-3679d0035967 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:48.483324 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-84bea49b-2c15-4318-8aa0-3679d0035967 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:48.484101 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-84bea49b-2c15-4318-8aa0-3679d0035967 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:48.485270 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-84bea49b-2c15-4318-8aa0-3679d0035967 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:48.485927 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-84bea49b-2c15-4318-8aa0-3679d0035967 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:48.618997 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-84bea49b-2c15-4318-8aa0-3679d0035967 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:48.627779 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-84bea49b-2c15-4318-8aa0-3679d0035967 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1570 microversion: 2.1 time: 0.161063 May 26 12:40:48.628448 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 446/880] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:48 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:49.646662 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-3442993d-577e-424c-b64c-34348180cc7d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:49.647423 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-3442993d-577e-424c-b64c-34348180cc7d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:49.656292 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3442993d-577e-424c-b64c-34348180cc7d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:49.656759 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3442993d-577e-424c-b64c-34348180cc7d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:49.657560 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3442993d-577e-424c-b64c-34348180cc7d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:49.657992 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3442993d-577e-424c-b64c-34348180cc7d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:49.911005 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-3442993d-577e-424c-b64c-34348180cc7d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:49.920927 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-3442993d-577e-424c-b64c-34348180cc7d tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1570 microversion: 2.1 time: 0.278142 May 26 12:40:49.921502 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 435/881] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:49 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1570 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:50.939088 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-a1d4f082-dac8-440e-a63b-b446cf95db7b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:50.940404 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-a1d4f082-dac8-440e-a63b-b446cf95db7b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:50.946998 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a1d4f082-dac8-440e-a63b-b446cf95db7b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:50.947915 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a1d4f082-dac8-440e-a63b-b446cf95db7b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:50.948928 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a1d4f082-dac8-440e-a63b-b446cf95db7b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:50.949378 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a1d4f082-dac8-440e-a63b-b446cf95db7b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:51.109083 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-a1d4f082-dac8-440e-a63b-b446cf95db7b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:51.116664 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-a1d4f082-dac8-440e-a63b-b446cf95db7b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1570 microversion: 2.1 time: 0.181551 May 26 12:40:51.126758 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 447/882] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:50 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1570 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:52.135725 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-a6cf268a-2082-442b-a295-90f9d5beebc9 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:52.136760 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-a6cf268a-2082-442b-a295-90f9d5beebc9 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:52.145077 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a6cf268a-2082-442b-a295-90f9d5beebc9 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:52.145529 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a6cf268a-2082-442b-a295-90f9d5beebc9 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:52.146299 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a6cf268a-2082-442b-a295-90f9d5beebc9 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:52.146741 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a6cf268a-2082-442b-a295-90f9d5beebc9 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:52.315307 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a6cf268a-2082-442b-a295-90f9d5beebc9 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:52.324939 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-a6cf268a-2082-442b-a295-90f9d5beebc9 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1570 microversion: 2.1 time: 0.194259 May 26 12:40:52.325757 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 436/883] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:52 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1570 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:53.342970 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-58b12a4f-6feb-4f71-96c9-34e2da1f3857 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:53.343647 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-58b12a4f-6feb-4f71-96c9-34e2da1f3857 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:53.350323 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-58b12a4f-6feb-4f71-96c9-34e2da1f3857 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:53.350776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-58b12a4f-6feb-4f71-96c9-34e2da1f3857 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:53.351551 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-58b12a4f-6feb-4f71-96c9-34e2da1f3857 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:53.351994 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-58b12a4f-6feb-4f71-96c9-34e2da1f3857 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:53.484447 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-58b12a4f-6feb-4f71-96c9-34e2da1f3857 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:53.491939 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-58b12a4f-6feb-4f71-96c9-34e2da1f3857 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1511 microversion: 2.1 time: 0.152986 May 26 12:40:53.492495 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 448/884] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:53 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:53.508552 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-7b20adb3-a157-4583-9c28-b93d6ada6fa3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:40:53.509148 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-7b20adb3-a157-4583-9c28-b93d6ada6fa3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:53.516917 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7b20adb3-a157-4583-9c28-b93d6ada6fa3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:53.517370 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7b20adb3-a157-4583-9c28-b93d6ada6fa3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:53.518128 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7b20adb3-a157-4583-9c28-b93d6ada6fa3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:53.518565 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7b20adb3-a157-4583-9c28-b93d6ada6fa3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:53.522959 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:53.594795 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-7b20adb3-a157-4583-9c28-b93d6ada6fa3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "POST /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273/action" status: 202 len: 0 microversion: 2.1 time: 0.090003 May 26 12:40:53.595420 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 437/885] 10.222.0.39 () {60 vars in 1277 bytes} [Thu May 26 12:40:53 2022] POST /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:40:53.604195 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d0377235-1b84-46ca-8a8d-ebfa28aeeb96 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:53.605073 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d0377235-1b84-46ca-8a8d-ebfa28aeeb96 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:53.611339 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d0377235-1b84-46ca-8a8d-ebfa28aeeb96 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:53.611868 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d0377235-1b84-46ca-8a8d-ebfa28aeeb96 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:53.612743 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d0377235-1b84-46ca-8a8d-ebfa28aeeb96 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:53.613250 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d0377235-1b84-46ca-8a8d-ebfa28aeeb96 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:53.749079 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d0377235-1b84-46ca-8a8d-ebfa28aeeb96 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:53.756501 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-d0377235-1b84-46ca-8a8d-ebfa28aeeb96 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1519 microversion: 2.1 time: 0.156747 May 26 12:40:53.757093 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 449/886] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:53 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:40:54.777148 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f89622ae-c9ad-43a7-a078-09c2706e3dc4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:54.777893 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-f89622ae-c9ad-43a7-a078-09c2706e3dc4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:54.784398 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f89622ae-c9ad-43a7-a078-09c2706e3dc4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:54.784885 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f89622ae-c9ad-43a7-a078-09c2706e3dc4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:54.785651 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f89622ae-c9ad-43a7-a078-09c2706e3dc4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:54.786094 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f89622ae-c9ad-43a7-a078-09c2706e3dc4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:54.921286 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-f89622ae-c9ad-43a7-a078-09c2706e3dc4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:54.928756 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-f89622ae-c9ad-43a7-a078-09c2706e3dc4 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1521 microversion: 2.1 time: 0.156755 May 26 12:40:54.929386 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 438/887] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:54 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:55.448650 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-ced3eafd-06f1-4896-a0e5-bfb4ffe19b3e req-19d7bb69-faff-4f18-81c9-235a61f69299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a42e497c-0646-4450-9f42-f8da46762273", "name": "network-vif-unplugged", "status": "completed", "tag": "e2c6e6e5-7173-4fde-a2ee-0c73b6a833ac"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:40:55.458360 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-ced3eafd-06f1-4896-a0e5-bfb4ffe19b3e req-19d7bb69-faff-4f18-81c9-235a61f69299 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:55.459215 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-ced3eafd-06f1-4896-a0e5-bfb4ffe19b3e req-19d7bb69-faff-4f18-81c9-235a61f69299 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:55.471970 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.compute.server_external_events [req-ced3eafd-06f1-4896-a0e5-bfb4ffe19b3e req-19d7bb69-faff-4f18-81c9-235a61f69299 service nova] Unable to find a host for instance a42e497c-0646-4450-9f42-f8da46762273. Dropping event network-vif-unplugged {{(pid=124133) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 12:40:55.472915 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-ced3eafd-06f1-4896-a0e5-bfb4ffe19b3e req-19d7bb69-faff-4f18-81c9-235a61f69299 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028777 May 26 12:40:55.473504 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 450/888] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 26 12:40:55.946384 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-3489c76f-d8ae-4a79-9c8c-6e1f1cc1b83f tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:55.946997 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-3489c76f-d8ae-4a79-9c8c-6e1f1cc1b83f tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:55.954108 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3489c76f-d8ae-4a79-9c8c-6e1f1cc1b83f tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:55.954562 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3489c76f-d8ae-4a79-9c8c-6e1f1cc1b83f tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:55.955328 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3489c76f-d8ae-4a79-9c8c-6e1f1cc1b83f tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:55.955771 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3489c76f-d8ae-4a79-9c8c-6e1f1cc1b83f tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:56.085774 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-3489c76f-d8ae-4a79-9c8c-6e1f1cc1b83f tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:56.094209 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-3489c76f-d8ae-4a79-9c8c-6e1f1cc1b83f tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1577 microversion: 2.1 time: 0.151711 May 26 12:40:56.094771 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 439/889] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:55 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:57.111537 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-4610f653-7279-4df1-b522-27df9532eebc tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:57.112130 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-4610f653-7279-4df1-b522-27df9532eebc tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:57.118753 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4610f653-7279-4df1-b522-27df9532eebc tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:57.119200 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4610f653-7279-4df1-b522-27df9532eebc tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:57.120089 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4610f653-7279-4df1-b522-27df9532eebc tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:57.120624 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4610f653-7279-4df1-b522-27df9532eebc tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:57.254449 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-4610f653-7279-4df1-b522-27df9532eebc tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:57.256779 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:57.263964 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-4610f653-7279-4df1-b522-27df9532eebc tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1577 microversion: 2.1 time: 0.156044 May 26 12:40:57.264524 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 451/890] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:57 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:58.280513 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-35831733-9a70-4c4c-b01e-79274686c6ef tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:58.281370 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-35831733-9a70-4c4c-b01e-79274686c6ef tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:58.287611 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-35831733-9a70-4c4c-b01e-79274686c6ef tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:58.288055 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-35831733-9a70-4c4c-b01e-79274686c6ef tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:58.288839 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-35831733-9a70-4c4c-b01e-79274686c6ef tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:58.289268 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-35831733-9a70-4c4c-b01e-79274686c6ef tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:58.418403 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-35831733-9a70-4c4c-b01e-79274686c6ef tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:58.425865 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-35831733-9a70-4c4c-b01e-79274686c6ef tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1577 microversion: 2.1 time: 0.149231 May 26 12:40:58.426417 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 440/891] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:58 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:40:59.443596 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-0989faa2-b225-408a-98e4-2f9f57e79083 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:40:59.444218 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-0989faa2-b225-408a-98e4-2f9f57e79083 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:40:59.452293 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0989faa2-b225-408a-98e4-2f9f57e79083 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:59.452741 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0989faa2-b225-408a-98e4-2f9f57e79083 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:59.453505 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0989faa2-b225-408a-98e4-2f9f57e79083 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:40:59.453998 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0989faa2-b225-408a-98e4-2f9f57e79083 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:40:59.621086 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-0989faa2-b225-408a-98e4-2f9f57e79083 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:40:59.628552 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-0989faa2-b225-408a-98e4-2f9f57e79083 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1577 microversion: 2.1 time: 0.188976 May 26 12:40:59.629141 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 452/892] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:40:59 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1577 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:00.646406 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-301ebb00-f536-44d0-b244-a905b9e68f1e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:00.647037 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-301ebb00-f536-44d0-b244-a905b9e68f1e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:00.654057 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-301ebb00-f536-44d0-b244-a905b9e68f1e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:00.654509 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-301ebb00-f536-44d0-b244-a905b9e68f1e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:00.655289 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-301ebb00-f536-44d0-b244-a905b9e68f1e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:00.655822 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-301ebb00-f536-44d0-b244-a905b9e68f1e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:01.049916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-301ebb00-f536-44d0-b244-a905b9e68f1e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:01.058589 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-301ebb00-f536-44d0-b244-a905b9e68f1e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1577 microversion: 2.1 time: 0.415932 May 26 12:41:01.059250 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 441/893] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:41:00 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1577 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:02.076220 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-15ff772a-acd1-44b5-907b-a851e9c2dff3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:02.076864 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-15ff772a-acd1-44b5-907b-a851e9c2dff3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:02.079193 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:02.084489 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-15ff772a-acd1-44b5-907b-a851e9c2dff3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:02.085005 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-15ff772a-acd1-44b5-907b-a851e9c2dff3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:02.086104 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-15ff772a-acd1-44b5-907b-a851e9c2dff3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:02.086216 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-15ff772a-acd1-44b5-907b-a851e9c2dff3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:02.221649 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-15ff772a-acd1-44b5-907b-a851e9c2dff3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:02.228973 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-15ff772a-acd1-44b5-907b-a851e9c2dff3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1577 microversion: 2.1 time: 0.157647 May 26 12:41:02.229644 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 453/894] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:41:02 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:03.246584 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-3c217abd-c10e-429f-ad1c-4c18fde61f3a tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:03.247193 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-3c217abd-c10e-429f-ad1c-4c18fde61f3a tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:03.253702 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3c217abd-c10e-429f-ad1c-4c18fde61f3a tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:03.254143 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3c217abd-c10e-429f-ad1c-4c18fde61f3a tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:03.254891 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3c217abd-c10e-429f-ad1c-4c18fde61f3a tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:03.255323 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3c217abd-c10e-429f-ad1c-4c18fde61f3a tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:03.397896 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-3c217abd-c10e-429f-ad1c-4c18fde61f3a tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:03.406320 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-3c217abd-c10e-429f-ad1c-4c18fde61f3a tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1577 microversion: 2.1 time: 0.163936 May 26 12:41:03.406934 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 442/895] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:41:03 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:04.424022 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-2f0b8f00-2c09-42b6-b033-ad1661e087ac tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:04.424640 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-2f0b8f00-2c09-42b6-b033-ad1661e087ac tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:04.431134 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2f0b8f00-2c09-42b6-b033-ad1661e087ac tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:04.431578 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2f0b8f00-2c09-42b6-b033-ad1661e087ac tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:04.432380 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2f0b8f00-2c09-42b6-b033-ad1661e087ac tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:04.433031 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2f0b8f00-2c09-42b6-b033-ad1661e087ac tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:04.622054 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-2f0b8f00-2c09-42b6-b033-ad1661e087ac tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:04.629931 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-2f0b8f00-2c09-42b6-b033-ad1661e087ac tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1577 microversion: 2.1 time: 0.210063 May 26 12:41:04.630499 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 454/896] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:41:04 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1577 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:05.647231 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-87c6f8ad-f15e-420f-93fe-c856a8cfb80b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:05.647974 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-87c6f8ad-f15e-420f-93fe-c856a8cfb80b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:05.650475 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:05.657074 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-87c6f8ad-f15e-420f-93fe-c856a8cfb80b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:05.657074 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-87c6f8ad-f15e-420f-93fe-c856a8cfb80b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:05.657357 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-87c6f8ad-f15e-420f-93fe-c856a8cfb80b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:05.657790 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-87c6f8ad-f15e-420f-93fe-c856a8cfb80b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:05.800467 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-87c6f8ad-f15e-420f-93fe-c856a8cfb80b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:05.809076 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-87c6f8ad-f15e-420f-93fe-c856a8cfb80b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1577 microversion: 2.1 time: 0.165453 May 26 12:41:05.809731 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 443/897] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:41:05 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:06.827203 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-398ed0e1-4a03-4570-a1ba-8ccdbf0db1f3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:06.828171 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-398ed0e1-4a03-4570-a1ba-8ccdbf0db1f3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:06.835664 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-398ed0e1-4a03-4570-a1ba-8ccdbf0db1f3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:06.836326 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-398ed0e1-4a03-4570-a1ba-8ccdbf0db1f3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:06.837240 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-398ed0e1-4a03-4570-a1ba-8ccdbf0db1f3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:06.837727 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-398ed0e1-4a03-4570-a1ba-8ccdbf0db1f3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:06.979478 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-398ed0e1-4a03-4570-a1ba-8ccdbf0db1f3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:06.987281 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-398ed0e1-4a03-4570-a1ba-8ccdbf0db1f3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1577 microversion: 2.1 time: 0.165436 May 26 12:41:06.987941 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 455/898] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:41:06 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:08.005544 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-db6f76b2-6edc-432f-b078-dd19a8e0c1e5 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:08.006154 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-db6f76b2-6edc-432f-b078-dd19a8e0c1e5 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:08.012799 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-db6f76b2-6edc-432f-b078-dd19a8e0c1e5 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:08.013254 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-db6f76b2-6edc-432f-b078-dd19a8e0c1e5 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:08.014272 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-db6f76b2-6edc-432f-b078-dd19a8e0c1e5 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:08.014710 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-db6f76b2-6edc-432f-b078-dd19a8e0c1e5 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:08.159211 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-db6f76b2-6edc-432f-b078-dd19a8e0c1e5 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:08.167718 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-db6f76b2-6edc-432f-b078-dd19a8e0c1e5 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1577 microversion: 2.1 time: 0.165981 May 26 12:41:08.168266 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 444/899] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:41:08 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:09.184961 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-487fb128-9a1a-43f2-ba1a-f1363a47f1c6 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:09.185562 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-487fb128-9a1a-43f2-ba1a-f1363a47f1c6 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:09.192176 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-487fb128-9a1a-43f2-ba1a-f1363a47f1c6 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:09.192635 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-487fb128-9a1a-43f2-ba1a-f1363a47f1c6 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:09.193551 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-487fb128-9a1a-43f2-ba1a-f1363a47f1c6 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:09.193869 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-487fb128-9a1a-43f2-ba1a-f1363a47f1c6 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:09.328319 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-487fb128-9a1a-43f2-ba1a-f1363a47f1c6 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:09.335882 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-487fb128-9a1a-43f2-ba1a-f1363a47f1c6 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1577 microversion: 2.1 time: 0.154855 May 26 12:41:09.336459 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 456/900] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:41:09 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:10.353114 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-ff0c60fe-5532-4232-bbdd-a4cd8cc7249e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:10.353719 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-ff0c60fe-5532-4232-bbdd-a4cd8cc7249e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:10.360609 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ff0c60fe-5532-4232-bbdd-a4cd8cc7249e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:10.361085 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ff0c60fe-5532-4232-bbdd-a4cd8cc7249e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:10.361868 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ff0c60fe-5532-4232-bbdd-a4cd8cc7249e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:10.362301 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ff0c60fe-5532-4232-bbdd-a4cd8cc7249e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:10.513005 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ff0c60fe-5532-4232-bbdd-a4cd8cc7249e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:10.516885 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-ff0c60fe-5532-4232-bbdd-a4cd8cc7249e tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1577 microversion: 2.1 time: 0.167540 May 26 12:41:10.517448 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 445/901] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:41:10 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:11.535499 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-da2e5920-c804-4710-8c84-6ed51d3f8a22 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:11.536660 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-da2e5920-c804-4710-8c84-6ed51d3f8a22 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:11.544320 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-da2e5920-c804-4710-8c84-6ed51d3f8a22 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:11.544929 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-da2e5920-c804-4710-8c84-6ed51d3f8a22 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:11.545724 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-da2e5920-c804-4710-8c84-6ed51d3f8a22 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:11.546175 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-da2e5920-c804-4710-8c84-6ed51d3f8a22 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:11.567550 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-165b62c7-e8a7-4cc1-aa37-ebbdbeda7515 req-538c1e3a-26af-4b2c-8327-a17e3858d53c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a42e497c-0646-4450-9f42-f8da46762273", "name": "network-vif-plugged", "status": "completed", "tag": "e2c6e6e5-7173-4fde-a2ee-0c73b6a833ac"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:41:11.578246 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-165b62c7-e8a7-4cc1-aa37-ebbdbeda7515 req-538c1e3a-26af-4b2c-8327-a17e3858d53c service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:11.578838 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-165b62c7-e8a7-4cc1-aa37-ebbdbeda7515 req-538c1e3a-26af-4b2c-8327-a17e3858d53c service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:11.594080 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-165b62c7-e8a7-4cc1-aa37-ebbdbeda7515 req-538c1e3a-26af-4b2c-8327-a17e3858d53c service nova] Creating event network-vif-plugged:e2c6e6e5-7173-4fde-a2ee-0c73b6a833ac for instance a42e497c-0646-4450-9f42-f8da46762273 on hv-cinder-81514 May 26 12:41:11.599691 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-165b62c7-e8a7-4cc1-aa37-ebbdbeda7515 req-538c1e3a-26af-4b2c-8327-a17e3858d53c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035893 May 26 12:41:11.601087 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 446/902] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:41:11.685712 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-da2e5920-c804-4710-8c84-6ed51d3f8a22 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:11.693312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-da2e5920-c804-4710-8c84-6ed51d3f8a22 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1577 microversion: 2.1 time: 0.162193 May 26 12:41:11.693866 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 457/903] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:41:11 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:12.715202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-c62346ce-86fb-49b4-a786-1d67f19df78c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:12.715901 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-c62346ce-86fb-49b4-a786-1d67f19df78c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:12.722327 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c62346ce-86fb-49b4-a786-1d67f19df78c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:12.722776 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c62346ce-86fb-49b4-a786-1d67f19df78c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:12.723534 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c62346ce-86fb-49b4-a786-1d67f19df78c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:12.724024 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c62346ce-86fb-49b4-a786-1d67f19df78c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:12.868870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c62346ce-86fb-49b4-a786-1d67f19df78c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:12.877857 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-c62346ce-86fb-49b4-a786-1d67f19df78c tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1577 microversion: 2.1 time: 0.170525 May 26 12:41:12.878430 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 447/904] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:41:12 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:13.894589 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-0b4484f3-dd52-4d00-a43b-0bcee4886d2a tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:13.895234 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-0b4484f3-dd52-4d00-a43b-0bcee4886d2a tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:13.902357 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0b4484f3-dd52-4d00-a43b-0bcee4886d2a tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:13.902812 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0b4484f3-dd52-4d00-a43b-0bcee4886d2a tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:13.903610 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0b4484f3-dd52-4d00-a43b-0bcee4886d2a tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:13.904052 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0b4484f3-dd52-4d00-a43b-0bcee4886d2a tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:14.048105 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-0b4484f3-dd52-4d00-a43b-0bcee4886d2a tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:14.055800 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-0b4484f3-dd52-4d00-a43b-0bcee4886d2a tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1564 microversion: 2.1 time: 0.165185 May 26 12:41:14.056366 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 458/905] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:41:13 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:42.896292 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-7a19f680-c23e-495f-825f-2abeb2efd228 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:42.897237 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-7a19f680-c23e-495f-825f-2abeb2efd228 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:42.899367 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=9 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:42.900016 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:42.906772 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7a19f680-c23e-495f-825f-2abeb2efd228 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:42.907223 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7a19f680-c23e-495f-825f-2abeb2efd228 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:42.907987 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7a19f680-c23e-495f-825f-2abeb2efd228 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:42.908423 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7a19f680-c23e-495f-825f-2abeb2efd228 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:42.938713 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-7a19f680-c23e-495f-825f-2abeb2efd228 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046495 May 26 12:41:42.939254 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 448/906] 10.222.0.39 () {58 vars in 1301 bytes} [Thu May 26 12:41:42 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:41:42.998033 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-417681ab-44f4-45dc-a1b2-4e0cf6bbb402 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:42.998527 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-417681ab-44f4-45dc-a1b2-4e0cf6bbb402 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:43.002291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=11 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:43.002928 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=43 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:43.008179 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-417681ab-44f4-45dc-a1b2-4e0cf6bbb402 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:43.008634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-417681ab-44f4-45dc-a1b2-4e0cf6bbb402 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:43.009430 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-417681ab-44f4-45dc-a1b2-4e0cf6bbb402 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:43.009872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-417681ab-44f4-45dc-a1b2-4e0cf6bbb402 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:43.034797 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-417681ab-44f4-45dc-a1b2-4e0cf6bbb402 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Going to try to terminate instance {{(pid=124133) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:41:43.110896 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-417681ab-44f4-45dc-a1b2-4e0cf6bbb402 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 204 len: 0 microversion: 2.1 time: 0.115754 May 26 12:41:43.111390 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 459/907] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:41:42 2022] DELETE /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:41:43.119679 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-2d45bdc1-ff19-4f36-a243-7c7fe685682d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:43.120317 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-2d45bdc1-ff19-4f36-a243-7c7fe685682d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:43.127622 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2d45bdc1-ff19-4f36-a243-7c7fe685682d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:43.128063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2d45bdc1-ff19-4f36-a243-7c7fe685682d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:43.128898 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2d45bdc1-ff19-4f36-a243-7c7fe685682d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:43.129591 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2d45bdc1-ff19-4f36-a243-7c7fe685682d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:43.262725 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2d45bdc1-ff19-4f36-a243-7c7fe685682d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:43.270706 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-2d45bdc1-ff19-4f36-a243-7c7fe685682d tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1671 microversion: 2.1 time: 0.154855 May 26 12:41:43.271258 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 449/908] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:41:43 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:44.288184 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-96651b2e-ef63-4719-a0f8-34c4541ac93a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:44.288914 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-96651b2e-ef63-4719-a0f8-34c4541ac93a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:44.294923 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-96651b2e-ef63-4719-a0f8-34c4541ac93a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:44.295379 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-96651b2e-ef63-4719-a0f8-34c4541ac93a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:44.296141 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-96651b2e-ef63-4719-a0f8-34c4541ac93a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:44.296582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-96651b2e-ef63-4719-a0f8-34c4541ac93a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:44.428869 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-96651b2e-ef63-4719-a0f8-34c4541ac93a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:44.436225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-96651b2e-ef63-4719-a0f8-34c4541ac93a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1671 microversion: 2.1 time: 0.152469 May 26 12:41:44.436807 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 460/909] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:41:44 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:44.464948 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-97ef2f93-e50b-4ef1-be2b-59b1cbbe2345 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:44.466285 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-97ef2f93-e50b-4ef1-be2b-59b1cbbe2345 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:44.478022 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-97ef2f93-e50b-4ef1-be2b-59b1cbbe2345 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:44.478467 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-97ef2f93-e50b-4ef1-be2b-59b1cbbe2345 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:44.479226 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-97ef2f93-e50b-4ef1-be2b-59b1cbbe2345 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:44.479663 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-97ef2f93-e50b-4ef1-be2b-59b1cbbe2345 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:44.504059 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-97ef2f93-e50b-4ef1-be2b-59b1cbbe2345 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f/ips" status: 200 len: 149 microversion: 2.1 time: 0.043332 May 26 12:41:44.504609 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 450/910] 10.222.0.39 () {58 vars in 1247 bytes} [Thu May 26 12:41:44 2022] GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:41:45.454935 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-32a294c6-ca4c-4288-b26c-2ba18f72b4d1 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:45.455544 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-32a294c6-ca4c-4288-b26c-2ba18f72b4d1 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:45.462061 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-32a294c6-ca4c-4288-b26c-2ba18f72b4d1 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:45.462513 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-32a294c6-ca4c-4288-b26c-2ba18f72b4d1 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:45.463266 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-32a294c6-ca4c-4288-b26c-2ba18f72b4d1 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:45.463705 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-32a294c6-ca4c-4288-b26c-2ba18f72b4d1 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:45.600421 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-32a294c6-ca4c-4288-b26c-2ba18f72b4d1 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:45.607978 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-32a294c6-ca4c-4288-b26c-2ba18f72b4d1 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1671 microversion: 2.1 time: 0.157517 May 26 12:41:45.608548 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 461/911] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:41:45 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:46.624603 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-7443ee3c-7ab8-41c1-9dde-e618174808f6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:46.625369 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-7443ee3c-7ab8-41c1-9dde-e618174808f6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:46.631985 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7443ee3c-7ab8-41c1-9dde-e618174808f6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:46.632439 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7443ee3c-7ab8-41c1-9dde-e618174808f6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:46.633238 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7443ee3c-7ab8-41c1-9dde-e618174808f6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:46.633675 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7443ee3c-7ab8-41c1-9dde-e618174808f6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:46.762857 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-7443ee3c-7ab8-41c1-9dde-e618174808f6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:46.772036 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-7443ee3c-7ab8-41c1-9dde-e618174808f6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1671 microversion: 2.1 time: 0.151261 May 26 12:41:46.772597 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 451/912] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:41:46 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:47.789746 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-0979eda6-682e-47b7-8557-f8f3011cc06e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:47.790494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-0979eda6-682e-47b7-8557-f8f3011cc06e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:47.797384 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0979eda6-682e-47b7-8557-f8f3011cc06e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:47.797842 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0979eda6-682e-47b7-8557-f8f3011cc06e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:47.798606 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0979eda6-682e-47b7-8557-f8f3011cc06e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:47.799044 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0979eda6-682e-47b7-8557-f8f3011cc06e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:47.933116 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-0979eda6-682e-47b7-8557-f8f3011cc06e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:47.941541 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-0979eda6-682e-47b7-8557-f8f3011cc06e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1671 microversion: 2.1 time: 0.155648 May 26 12:41:47.942121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 462/913] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:41:47 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:48.967271 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-2d311e3c-145e-44dd-b5f3-2416a6f76fb6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:48.967889 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-2d311e3c-145e-44dd-b5f3-2416a6f76fb6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:48.975156 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2d311e3c-145e-44dd-b5f3-2416a6f76fb6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:48.975606 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2d311e3c-145e-44dd-b5f3-2416a6f76fb6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:48.976379 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2d311e3c-145e-44dd-b5f3-2416a6f76fb6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:48.976850 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2d311e3c-145e-44dd-b5f3-2416a6f76fb6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:49.232840 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2d311e3c-145e-44dd-b5f3-2416a6f76fb6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:49.240659 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-2d311e3c-145e-44dd-b5f3-2416a6f76fb6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1671 microversion: 2.1 time: 0.285320 May 26 12:41:49.241251 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 452/914] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:41:48 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1671 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:49.698025 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-ea067422-12ad-4219-a450-50f5c44e2891 req-b41a1c31-162b-4454-8e30-c588cb1ed55d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1220de98-5d9e-4c46-937d-52199dd249c3", "name": "network-vif-deleted", "tag": "d74c1ce6-0777-4077-8c1e-3845bcaf0256"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:41:49.708085 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-ea067422-12ad-4219-a450-50f5c44e2891 req-b41a1c31-162b-4454-8e30-c588cb1ed55d service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:49.708540 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-ea067422-12ad-4219-a450-50f5c44e2891 req-b41a1c31-162b-4454-8e30-c588cb1ed55d service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:49.720339 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-ea067422-12ad-4219-a450-50f5c44e2891 req-b41a1c31-162b-4454-8e30-c588cb1ed55d service nova] Creating event network-vif-deleted:d74c1ce6-0777-4077-8c1e-3845bcaf0256 for instance 1220de98-5d9e-4c46-937d-52199dd249c3 on hv-cinder-81514 May 26 12:41:49.725158 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-ea067422-12ad-4219-a450-50f5c44e2891 req-b41a1c31-162b-4454-8e30-c588cb1ed55d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030734 May 26 12:41:49.725901 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 463/915] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:41:50.257923 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-50de7b4a-72fa-495e-bd4e-8a57cc460c2a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:50.258533 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-50de7b4a-72fa-495e-bd4e-8a57cc460c2a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:50.265343 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-50de7b4a-72fa-495e-bd4e-8a57cc460c2a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:50.266769 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-50de7b4a-72fa-495e-bd4e-8a57cc460c2a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:50.267693 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-50de7b4a-72fa-495e-bd4e-8a57cc460c2a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:50.268128 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-50de7b4a-72fa-495e-bd4e-8a57cc460c2a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:50.302190 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-50de7b4a-72fa-495e-bd4e-8a57cc460c2a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:50.302635 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-50de7b4a-72fa-495e-bd4e-8a57cc460c2a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:50.303260 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.objects.instance [None req-50de7b4a-72fa-495e-bd4e-8a57cc460c2a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lazy-loading 'fault' on Instance uuid 1220de98-5d9e-4c46-937d-52199dd249c3 {{(pid=124134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:41:50.347423 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-50de7b4a-72fa-495e-bd4e-8a57cc460c2a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:50.354900 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-50de7b4a-72fa-495e-bd4e-8a57cc460c2a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 200 len: 1326 microversion: 2.1 time: 0.100788 May 26 12:41:50.355633 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 453/916] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:41:50 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 1326 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:41:51.372501 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-89e9f68a-db15-4a54-ad0a-adae7a5631fa tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:51.373227 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-89e9f68a-db15-4a54-ad0a-adae7a5631fa tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:51.379670 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-89e9f68a-db15-4a54-ad0a-adae7a5631fa tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:51.380117 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-89e9f68a-db15-4a54-ad0a-adae7a5631fa tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:51.380902 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-89e9f68a-db15-4a54-ad0a-adae7a5631fa tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:51.381340 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-89e9f68a-db15-4a54-ad0a-adae7a5631fa tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:51.395234 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-89e9f68a-db15-4a54-ad0a-adae7a5631fa tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] HTTP exception thrown: Instance 1220de98-5d9e-4c46-937d-52199dd249c3 could not be found. May 26 12:41:51.396839 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-89e9f68a-db15-4a54-ad0a-adae7a5631fa tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Request method failure captured: May 26 12:41:51.396839 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 HTTP/1.1 May 26 12:41:51.396839 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:41:51.396839 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:41:51.396839 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:41:51.396839 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:41:51.396839 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:41:51.396839 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:41:51.396839 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:41:51.396839 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:41:51.396839 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3Pu-saym90ZugmL3MHfzkh3-IPtVZXgzoR3exsnu8n8HoKOTtd8zpUAVsLjhxBU3j_zoT72IpEaxwJiXS--zqSas-twRwX9KEZXcZudPVAXGqSRSYJW1jsHAcB8R-kToK2lzxh_xwqg51Jpvzf-AAGhDWT6Uu6U-Dd3iI5K6i0lhdY May 26 12:41:51.396839 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:41:51.396839 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:41:51.396839 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:41:51.396839 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:41:51.396839 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:41:51.396839 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:41:51.396839 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: 079362a77e344c61af67f7b256545329 May 26 12:41:51.396839 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-AttachVolumeTestJSON-1419980377 May 26 12:41:51.396839 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:41:51.396839 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:41:51.399266 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/079362a77e344c61af67f7b256545329"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_079362a77e344c61af67f7b256545329", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/079362a77e344c61af67f7b256545329"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/079362a77e344c61af67f7b256545329"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:41:51.399266 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-AttachVolumeTestJSON-1419980377 May 26 12:41:51.399266 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: 079362a77e344c61af67f7b256545329 May 26 12:41:51.399266 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1419980377 May 26 12:41:51.399266 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-AttachVolumeTestJSON-1419980377-project May 26 12:41:51.399266 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:41:51.399266 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:41:51.399266 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: 1156b006d6e1426a84a521d397491135 May 26 12:41:51.399266 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-AttachVolumeTestJSON-1419980377-project May 26 12:41:51.399266 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: > May 26 12:41:51.399266 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Instance 1220de98-5d9e-4c46-937d-52199dd249c3 could not be found. May 26 12:41:51.399266 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': '1220de98-5d9e-4c46-937d-52199dd249c3'} May 26 12:41:51.400582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:41:51.400582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:41:51.400582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:41:51.400582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:41:51.400582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:41:51.400582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:41:51.400582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:41:51.400582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:41:51.400582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:41:51.400582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:41:51.400582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1220de98-5d9e-4c46-937d-52199dd249c3 could not be found. May 26 12:41:51.400582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:41:51.400582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:41:51.400582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:41:51.400582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:41:51.400582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:41:51.400582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:41:51.400582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:41:51.400582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:41:51.400582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:41:51.402833 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:41:51.402833 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:41:51.402833 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:41:51.402833 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:41:51.402833 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:41:51.402833 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:41:51.402833 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:41:51.402833 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1220de98-5d9e-4c46-937d-52199dd249c3 could not be found. May 26 12:41:51.402833 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:41:51.402833 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:41:51.402833 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:41:51.402833 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:41:51.402833 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:41:51.402833 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:41:51.402833 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:41:51.402833 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:41:51.402833 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1220de98-5d9e-4c46-937d-52199dd249c3 could not be found. May 26 12:41:51.402833 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:41:51.404797 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-89e9f68a-db15-4a54-ad0a-adae7a5631fa tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Returning 404 to user: Instance 1220de98-5d9e-4c46-937d-52199dd249c3 could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:41:51.404797 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-89e9f68a-db15-4a54-ad0a-adae7a5631fa tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 404 len: 111 microversion: 2.1 time: 0.030522 May 26 12:41:51.404797 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 464/917] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:41:51 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:41:51.407892 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f3f42683-fd37-4ab6-bbca-70e428099420 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '.version_select at 0x7fed312a91f0>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:51.424786 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-f3f42683-fd37-4ab6-bbca-70e428099420 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-100175735" status: 202 len: 0 microversion: 2.1 time: 0.021564 May 26 12:41:51.425301 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 454/918] 10.222.0.39 () {58 vars in 1217 bytes} [Thu May 26 12:41:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-100175735 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:41:52.061731 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-2ac6aee1-d039-40a5-9de5-69bfc8fd585e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Action: 'create', calling method: .version_select at 0x7fed3131e940>, body: {"keypair": {"name": "tempest-keypair-852620833", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD96CfF0ttdF5aoycgZz+FUSuEceGCt3uIDIJ+7aHQ443MHHCFHHlWjfZCrhvbNujMCg6IXYOiI6pivLeVrkGhVBBb06qaRzLQj7iWxw85zjMyKa2lOaWhGB4jMotAm50Q=="}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:41:52.076392 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-2ac6aee1-d039-40a5-9de5-69bfc8fd585e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Getting quotas for project 079362a77e344c61af67f7b256545329. Resources: {'key_pairs'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:41:52.080885 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-2ac6aee1-d039-40a5-9de5-69bfc8fd585e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Getting quotas for user 1156b006d6e1426a84a521d397491135 and project 079362a77e344c61af67f7b256545329. Resources: {'key_pairs'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:41:52.103703 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-2ac6aee1-d039-40a5-9de5-69bfc8fd585e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045808 May 26 12:41:52.104291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 465/919] 10.222.0.39 () {60 vars in 1158 bytes} [Thu May 26 12:41:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:41:52.125771 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-aa69542f-cda3-4c41-b61e-020b557b731e tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a506960e-3bf3-4322-ade9-a91c4360d562"}} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:41:52.126847 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-aa69542f-cda3-4c41-b61e-020b557b731e tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:52.133696 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-aa69542f-cda3-4c41-b61e-020b557b731e tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:52.134455 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-aa69542f-cda3-4c41-b61e-020b557b731e tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:52.135348 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-aa69542f-cda3-4c41-b61e-020b557b731e tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:52.135846 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-aa69542f-cda3-4c41-b61e-020b557b731e tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:52.419990 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-aa69542f-cda3-4c41-b61e-020b557b731e tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "POST /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300841 May 26 12:41:52.421322 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 455/920] 10.222.0.39 () {60 vars in 1322 bytes} [Thu May 26 12:41:52 2022] POST /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:41:53.636313 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-8760601c-4a6a-46ad-9287-3ed9539e5d71 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1774722605", "imageRef": "7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5e8da0b1-ba0e-4cd0-92d2-6bbdcd16b096"}], "security_groups": [{"name": "tempest-securitygroup--1246523240"}], "key_name": "tempest-keypair-852620833", "user_data": "}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:41:53.736478 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.network.neutron [None req-8760601c-4a6a-46ad-9287-3ed9539e5d71 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] validate_networks() for [('5e8da0b1-ba0e-4cd0-92d2-6bbdcd16b096', None, None, None, None, None)] {{(pid=124133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:41:54.098633 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-8760601c-4a6a-46ad-9287-3ed9539e5d71 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Flavor limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:41:54.099130 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-8760601c-4a6a-46ad-9287-3ed9539e5d71 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Image limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:41:54.099697 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-8760601c-4a6a-46ad-9287-3ed9539e5d71 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Flavor pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:41:54.100219 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-8760601c-4a6a-46ad-9287-3ed9539e5d71 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Image pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:41:54.100690 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-8760601c-4a6a-46ad-9287-3ed9539e5d71 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:41:54.109680 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8760601c-4a6a-46ad-9287-3ed9539e5d71 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:54.110316 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8760601c-4a6a-46ad-9287-3ed9539e5d71 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:54.111110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8760601c-4a6a-46ad-9287-3ed9539e5d71 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:54.111549 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8760601c-4a6a-46ad-9287-3ed9539e5d71 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:54.128445 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-8760601c-4a6a-46ad-9287-3ed9539e5d71 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Getting quotas for project 079362a77e344c61af67f7b256545329. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:41:54.132370 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-8760601c-4a6a-46ad-9287-3ed9539e5d71 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Getting quotas for user 1156b006d6e1426a84a521d397491135 and project 079362a77e344c61af67f7b256545329. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:41:54.144560 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-8760601c-4a6a-46ad-9287-3ed9539e5d71 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Going to run 1 instances... {{(pid=124133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:41:54.146847 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-8760601c-4a6a-46ad-9287-3ed9539e5d71 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:41:54.195404 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-8760601c-4a6a-46ad-9287-3ed9539e5d71 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.564035 May 26 12:41:54.196026 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 466/921] 10.222.0.39 () {60 vars in 1146 bytes} [Thu May 26 12:41:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:41:54.207470 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-c850a6dc-8a81-4b6c-8582-e60440d3d359 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:54.208157 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-c850a6dc-8a81-4b6c-8582-e60440d3d359 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:54.263476 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c850a6dc-8a81-4b6c-8582-e60440d3d359 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:54.270406 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-c850a6dc-8a81-4b6c-8582-e60440d3d359 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d" status: 200 len: 1237 microversion: 2.1 time: 0.068095 May 26 12:41:54.271004 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 456/922] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:41:54 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:55.288502 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-25239838-b325-460a-a24a-a223991351ee tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:55.289861 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-25239838-b325-460a-a24a-a223991351ee tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:55.296534 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-25239838-b325-460a-a24a-a223991351ee tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:55.297148 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-25239838-b325-460a-a24a-a223991351ee tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:55.298168 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-25239838-b325-460a-a24a-a223991351ee tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:55.298677 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-25239838-b325-460a-a24a-a223991351ee tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:55.377439 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-25239838-b325-460a-a24a-a223991351ee tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:55.385321 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-25239838-b325-460a-a24a-a223991351ee tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d" status: 200 len: 1297 microversion: 2.1 time: 0.100282 May 26 12:41:55.386015 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 467/923] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:41:55 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d => generated 1297 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:56.403545 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6e83e4cd-6e64-4477-b8ec-84c47db71cb0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:56.404118 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-6e83e4cd-6e64-4477-b8ec-84c47db71cb0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:56.412015 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6e83e4cd-6e64-4477-b8ec-84c47db71cb0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:56.412462 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6e83e4cd-6e64-4477-b8ec-84c47db71cb0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:56.413467 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6e83e4cd-6e64-4477-b8ec-84c47db71cb0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:56.413696 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6e83e4cd-6e64-4477-b8ec-84c47db71cb0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:56.651418 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-6e83e4cd-6e64-4477-b8ec-84c47db71cb0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:56.664745 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-6e83e4cd-6e64-4477-b8ec-84c47db71cb0 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d" status: 200 len: 1363 microversion: 2.1 time: 0.264818 May 26 12:41:56.666033 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 457/924] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:41:56 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:56.869895 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-01ca8430-a376-4fa9-b68c-2a906f9f54dd req-4f3d0f97-01fa-4c80-9fac-6feabf31b512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "411d94dd-76cb-418b-bfac-d1948a57f92d", "tag": "b10bc25c-5ab6-4524-8866-5be0a8a8aad6"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:41:56.893948 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-01ca8430-a376-4fa9-b68c-2a906f9f54dd req-4f3d0f97-01fa-4c80-9fac-6feabf31b512 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:56.894546 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-01ca8430-a376-4fa9-b68c-2a906f9f54dd req-4f3d0f97-01fa-4c80-9fac-6feabf31b512 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:56.915214 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-01ca8430-a376-4fa9-b68c-2a906f9f54dd req-4f3d0f97-01fa-4c80-9fac-6feabf31b512 service nova] Creating event network-changed:b10bc25c-5ab6-4524-8866-5be0a8a8aad6 for instance 411d94dd-76cb-418b-bfac-d1948a57f92d on hv-cinder-81514 May 26 12:41:56.941572 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-01ca8430-a376-4fa9-b68c-2a906f9f54dd req-4f3d0f97-01fa-4c80-9fac-6feabf31b512 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075006 May 26 12:41:56.942656 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 468/925] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:41:57.682775 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-2e945ff9-1bd1-4a6e-83ca-3e3924812b94 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:57.683293 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-2e945ff9-1bd1-4a6e-83ca-3e3924812b94 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:57.690685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2e945ff9-1bd1-4a6e-83ca-3e3924812b94 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:57.691131 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2e945ff9-1bd1-4a6e-83ca-3e3924812b94 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:57.691882 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2e945ff9-1bd1-4a6e-83ca-3e3924812b94 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:57.692314 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2e945ff9-1bd1-4a6e-83ca-3e3924812b94 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:57.823702 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2e945ff9-1bd1-4a6e-83ca-3e3924812b94 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:57.831249 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-2e945ff9-1bd1-4a6e-83ca-3e3924812b94 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d" status: 200 len: 1363 microversion: 2.1 time: 0.152409 May 26 12:41:57.831796 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 458/926] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:41:57 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:41:58.849134 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-c7e4c378-2f78-4101-828d-b10153e84590 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:41:58.849827 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-c7e4c378-2f78-4101-828d-b10153e84590 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:41:58.856035 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c7e4c378-2f78-4101-828d-b10153e84590 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:58.856475 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c7e4c378-2f78-4101-828d-b10153e84590 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:58.857264 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c7e4c378-2f78-4101-828d-b10153e84590 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:41:58.857702 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c7e4c378-2f78-4101-828d-b10153e84590 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:41:58.985680 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-c7e4c378-2f78-4101-828d-b10153e84590 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:41:58.992999 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-c7e4c378-2f78-4101-828d-b10153e84590 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d" status: 200 len: 1363 microversion: 2.1 time: 0.149448 May 26 12:41:58.993556 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 469/927] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:41:58 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:00.009810 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-0e08a3d9-bb59-4943-b31e-54eb118a8c44 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:00.010422 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-0e08a3d9-bb59-4943-b31e-54eb118a8c44 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:00.017868 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0e08a3d9-bb59-4943-b31e-54eb118a8c44 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:00.018318 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0e08a3d9-bb59-4943-b31e-54eb118a8c44 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:00.019079 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0e08a3d9-bb59-4943-b31e-54eb118a8c44 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:00.019522 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0e08a3d9-bb59-4943-b31e-54eb118a8c44 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:00.152257 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-0e08a3d9-bb59-4943-b31e-54eb118a8c44 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:00.159916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-0e08a3d9-bb59-4943-b31e-54eb118a8c44 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d" status: 200 len: 1363 microversion: 2.1 time: 0.153950 May 26 12:42:00.160479 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 459/928] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:00 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:01.176313 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-c8f0c8c0-6d38-4b25-8bf6-017890ca7bf9 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:01.176962 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-c8f0c8c0-6d38-4b25-8bf6-017890ca7bf9 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:01.183375 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c8f0c8c0-6d38-4b25-8bf6-017890ca7bf9 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:01.183826 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c8f0c8c0-6d38-4b25-8bf6-017890ca7bf9 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:01.184587 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c8f0c8c0-6d38-4b25-8bf6-017890ca7bf9 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:01.185050 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c8f0c8c0-6d38-4b25-8bf6-017890ca7bf9 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:01.313964 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-c8f0c8c0-6d38-4b25-8bf6-017890ca7bf9 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:01.321562 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-c8f0c8c0-6d38-4b25-8bf6-017890ca7bf9 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d" status: 200 len: 1363 microversion: 2.1 time: 0.149091 May 26 12:42:01.322126 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 470/929] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:01 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:02.339023 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b1585465-5df7-459a-8532-6429f94d7bf6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:02.339611 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b1585465-5df7-459a-8532-6429f94d7bf6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:02.346795 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b1585465-5df7-459a-8532-6429f94d7bf6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:02.347243 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b1585465-5df7-459a-8532-6429f94d7bf6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:02.348000 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b1585465-5df7-459a-8532-6429f94d7bf6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:02.348438 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b1585465-5df7-459a-8532-6429f94d7bf6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:02.481036 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b1585465-5df7-459a-8532-6429f94d7bf6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:02.488580 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b1585465-5df7-459a-8532-6429f94d7bf6 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d" status: 200 len: 1363 microversion: 2.1 time: 0.153512 May 26 12:42:02.489168 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 460/930] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:02 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:03.506022 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e7e5e0b9-c02c-4774-9766-4c6db99df8d4 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:03.506641 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e7e5e0b9-c02c-4774-9766-4c6db99df8d4 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:03.513361 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e7e5e0b9-c02c-4774-9766-4c6db99df8d4 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:03.513815 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e7e5e0b9-c02c-4774-9766-4c6db99df8d4 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:03.514582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e7e5e0b9-c02c-4774-9766-4c6db99df8d4 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:03.515337 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e7e5e0b9-c02c-4774-9766-4c6db99df8d4 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:03.649477 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e7e5e0b9-c02c-4774-9766-4c6db99df8d4 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:03.658506 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e7e5e0b9-c02c-4774-9766-4c6db99df8d4 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d" status: 200 len: 1363 microversion: 2.1 time: 0.156342 May 26 12:42:03.659079 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 471/931] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:03 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:04.677554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-2cba8511-6d5e-466e-9670-33c3fda4d23e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:04.678123 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-2cba8511-6d5e-466e-9670-33c3fda4d23e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:04.680502 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell0:SELECT=2 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:04.686098 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2cba8511-6d5e-466e-9670-33c3fda4d23e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:04.686548 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2cba8511-6d5e-466e-9670-33c3fda4d23e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:04.687456 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2cba8511-6d5e-466e-9670-33c3fda4d23e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:04.687907 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2cba8511-6d5e-466e-9670-33c3fda4d23e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:05.129897 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2cba8511-6d5e-466e-9670-33c3fda4d23e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:05.138836 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-2cba8511-6d5e-466e-9670-33c3fda4d23e tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d" status: 200 len: 1363 microversion: 2.1 time: 0.465038 May 26 12:42:05.139697 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 461/932] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:04 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d => generated 1363 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:05.949605 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-a2ee3813-6bff-4b77-b544-272c4de230ea req-74ba65fd-c31c-4a0f-a72f-9b784d0e4558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "411d94dd-76cb-418b-bfac-d1948a57f92d", "name": "network-vif-plugged", "status": "completed", "tag": "b10bc25c-5ab6-4524-8866-5be0a8a8aad6"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:05.954484 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=2 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:05.955177 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=10 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:05.962471 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-a2ee3813-6bff-4b77-b544-272c4de230ea req-74ba65fd-c31c-4a0f-a72f-9b784d0e4558 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:05.962921 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-a2ee3813-6bff-4b77-b544-272c4de230ea req-74ba65fd-c31c-4a0f-a72f-9b784d0e4558 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:05.974608 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-a2ee3813-6bff-4b77-b544-272c4de230ea req-74ba65fd-c31c-4a0f-a72f-9b784d0e4558 service nova] Creating event network-vif-plugged:b10bc25c-5ab6-4524-8866-5be0a8a8aad6 for instance 411d94dd-76cb-418b-bfac-d1948a57f92d on hv-cinder-81514 May 26 12:42:05.979499 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-a2ee3813-6bff-4b77-b544-272c4de230ea req-74ba65fd-c31c-4a0f-a72f-9b784d0e4558 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033592 May 26 12:42:05.980149 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 472/933] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:42:06.156252 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-09ecd494-6ef0-4ef4-80bd-cc8cda8c6645 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:06.156878 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-09ecd494-6ef0-4ef4-80bd-cc8cda8c6645 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:06.163282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-09ecd494-6ef0-4ef4-80bd-cc8cda8c6645 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:06.163725 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-09ecd494-6ef0-4ef4-80bd-cc8cda8c6645 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:06.164481 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-09ecd494-6ef0-4ef4-80bd-cc8cda8c6645 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:06.164933 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-09ecd494-6ef0-4ef4-80bd-cc8cda8c6645 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:06.310602 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-077e5a50-2b59-4e81-9856-cd9725d6337c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a506960e-3bf3-4322-ade9-a91c4360d562"}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:06.311752 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-077e5a50-2b59-4e81-9856-cd9725d6337c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:06.318743 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-077e5a50-2b59-4e81-9856-cd9725d6337c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:06.319191 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-077e5a50-2b59-4e81-9856-cd9725d6337c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:06.319965 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-077e5a50-2b59-4e81-9856-cd9725d6337c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:06.320407 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-077e5a50-2b59-4e81-9856-cd9725d6337c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:06.365791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-09ecd494-6ef0-4ef4-80bd-cc8cda8c6645 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:06.373277 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-09ecd494-6ef0-4ef4-80bd-cc8cda8c6645 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d" status: 200 len: 1363 microversion: 2.1 time: 0.221014 May 26 12:42:06.373829 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 462/934] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:06 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:06.401212 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-077e5a50-2b59-4e81-9856-cd9725d6337c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] HTTP exception thrown: Invalid volume: volume a506960e-3bf3-4322-ade9-a91c4360d562 is already attached to instances: 0db35800-34bb-4fda-bbb9-971062a3b16f May 26 12:42:06.402985 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-077e5a50-2b59-4e81-9856-cd9725d6337c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Request method failure captured: May 26 12:42:06.402985 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: POST /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f/os-volume_attachments HTTP/1.1 May 26 12:42:06.402985 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:42:06.402985 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:42:06.402985 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:42:06.402985 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 74 May 26 12:42:06.402985 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:42:06.402985 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:42:06.402985 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:42:06.402985 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:42:06.402985 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3NlvcGUyXKMcR3f44eTcb9KUX9Z1HAOP6nfmLvSlYo0JIjkhlxQnvnKs5YzuXlFyVI90MMwVyxF6G0XRw3coPQTRjw_l752cMl_otjGJnnaQ4RjUOg-dE0XHNrSgowu0nH-j9SReMVUJ7YwVfxzPS5nbVTF1HJ2aVri9hxI7XdrhVs May 26 12:42:06.402985 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:42:06.402985 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:42:06.402985 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:42:06.402985 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:42:06.402985 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:42:06.402985 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:42:06.402985 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:42:06.402985 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:42:06.402985 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:42:06.402985 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:42:06.404562 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7ef656c0ca2943eb965bf10d4e943d27", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:42:06.404562 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:42:06.404562 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:42:06.404562 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:42:06.404562 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:42:06.404562 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:42:06.404562 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:42:06.404562 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: 7b14606965a74c71881595c71bdd2d58 May 26 12:42:06.404562 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:42:06.404562 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: May 26 12:42:06.404562 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {"volumeAttachment": {"volumeId": "a506960e-3bf3-4322-ade9-a91c4360d562"}} May 26 12:42:06.404562 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: > May 26 12:42:06.405494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Invalid volume: volume a506960e-3bf3-4322-ade9-a91c4360d562 is already attached to instances: 0db35800-34bb-4fda-bbb9-971062a3b16f May 26 12:42:06.405494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'server_id': '0db35800-34bb-4fda-bbb9-971062a3b16f', 'body': {'volumeAttachment': {'volumeId': 'a506960e-3bf3-4322-ade9-a91c4360d562'}}} May 26 12:42:06.405494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:42:06.405494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:42:06.405494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 12:42:06.405494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 12:42:06.405494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 12:42:06.405494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 12:42:06.405494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 12:42:06.405494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 12:42:06.405494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 12:42:06.405494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 12:42:06.405494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 12:42:06.405494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 12:42:06.405494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a506960e-3bf3-4322-ade9-a91c4360d562 is already attached to instances: 0db35800-34bb-4fda-bbb9-971062a3b16f May 26 12:42:06.405494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:42:06.405494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:42:06.405494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:42:06.405494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:42:06.407101 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:42:06.407101 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:42:06.407101 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:42:06.407101 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:42:06.407101 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:42:06.407101 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:42:06.407101 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:42:06.407101 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:42:06.407101 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:42:06.407101 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:42:06.407101 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:42:06.407101 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:42:06.407101 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 12:42:06.407101 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 12:42:06.407101 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a506960e-3bf3-4322-ade9-a91c4360d562 is already attached to instances: 0db35800-34bb-4fda-bbb9-971062a3b16f May 26 12:42:06.407101 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:42:06.407101 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:42:06.407101 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:42:06.407101 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:42:06.407101 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:42:06.408520 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:42:06.408520 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:42:06.408520 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:42:06.408520 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a506960e-3bf3-4322-ade9-a91c4360d562 is already attached to instances: 0db35800-34bb-4fda-bbb9-971062a3b16f May 26 12:42:06.408520 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:42:06.408520 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-077e5a50-2b59-4e81-9856-cd9725d6337c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Returning 400 to user: Invalid volume: volume a506960e-3bf3-4322-ade9-a91c4360d562 is already attached to instances: 0db35800-34bb-4fda-bbb9-971062a3b16f {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:42:06.408520 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-077e5a50-2b59-4e81-9856-cd9725d6337c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "POST /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098167 May 26 12:42:06.408520 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 473/935] 10.222.0.39 () {60 vars in 1322 bytes} [Thu May 26 12:42:06 2022] POST /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 26 12:42:06.465932 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-a5aab93c-7e23-4c3f-ad33-d36b2725c51d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:06.466429 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-a5aab93c-7e23-4c3f-ad33-d36b2725c51d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:06.472744 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a5aab93c-7e23-4c3f-ad33-d36b2725c51d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:06.473199 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a5aab93c-7e23-4c3f-ad33-d36b2725c51d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:06.473946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a5aab93c-7e23-4c3f-ad33-d36b2725c51d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:06.474375 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a5aab93c-7e23-4c3f-ad33-d36b2725c51d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:06.554308 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.objects.instance [None req-a5aab93c-7e23-4c3f-ad33-d36b2725c51d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lazy-loading 'services' on Instance uuid 0db35800-34bb-4fda-bbb9-971062a3b16f {{(pid=124134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:42:06.624283 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-a5aab93c-7e23-4c3f-ad33-d36b2725c51d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f/os-volume_attachments/a506960e-3bf3-4322-ade9-a91c4360d562" status: 202 len: 0 microversion: 2.1 time: 0.162133 May 26 12:42:06.624895 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 463/936] 10.222.0.39 () {58 vars in 1415 bytes} [Thu May 26 12:42:06 2022] DELETE /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f/os-volume_attachments/a506960e-3bf3-4322-ade9-a91c4360d562 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:42:06.633339 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-b53ef17f-75a7-47e1-93b9-c77a6f37422b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:06.634328 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-b53ef17f-75a7-47e1-93b9-c77a6f37422b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:06.640549 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b53ef17f-75a7-47e1-93b9-c77a6f37422b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:06.641064 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b53ef17f-75a7-47e1-93b9-c77a6f37422b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:06.641809 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b53ef17f-75a7-47e1-93b9-c77a6f37422b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:06.642250 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b53ef17f-75a7-47e1-93b9-c77a6f37422b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:06.673687 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-b53ef17f-75a7-47e1-93b9-c77a6f37422b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044190 May 26 12:42:06.674219 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 474/937] 10.222.0.39 () {58 vars in 1301 bytes} [Thu May 26 12:42:06 2022] GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:42:07.392994 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-3cd4ac28-ed8b-47d4-a301-5630291e0899 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:07.393679 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-3cd4ac28-ed8b-47d4-a301-5630291e0899 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:07.399872 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3cd4ac28-ed8b-47d4-a301-5630291e0899 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:07.400314 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3cd4ac28-ed8b-47d4-a301-5630291e0899 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:07.401092 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3cd4ac28-ed8b-47d4-a301-5630291e0899 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:07.401527 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3cd4ac28-ed8b-47d4-a301-5630291e0899 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:07.419329 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:07.535187 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-3cd4ac28-ed8b-47d4-a301-5630291e0899 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:07.542765 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-3cd4ac28-ed8b-47d4-a301-5630291e0899 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d" status: 200 len: 1363 microversion: 2.1 time: 0.155739 May 26 12:42:07.543323 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 464/938] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:07 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:07.684672 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-a8e4af10-6a32-4648-9007-7d1cace2eed4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:07.685573 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-a8e4af10-6a32-4648-9007-7d1cace2eed4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:07.692724 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a8e4af10-6a32-4648-9007-7d1cace2eed4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:07.693196 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a8e4af10-6a32-4648-9007-7d1cace2eed4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:07.693963 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a8e4af10-6a32-4648-9007-7d1cace2eed4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:07.694401 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a8e4af10-6a32-4648-9007-7d1cace2eed4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:07.873705 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-a8e4af10-6a32-4648-9007-7d1cace2eed4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193039 May 26 12:42:07.874262 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 475/939] 10.222.0.39 () {58 vars in 1301 bytes} [Thu May 26 12:42:07 2022] GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:42:08.559650 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b1ac8cf0-476d-433a-a2a5-fa19a61a5d28 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:08.560377 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b1ac8cf0-476d-433a-a2a5-fa19a61a5d28 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:08.567581 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b1ac8cf0-476d-433a-a2a5-fa19a61a5d28 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:08.568040 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b1ac8cf0-476d-433a-a2a5-fa19a61a5d28 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:08.568840 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b1ac8cf0-476d-433a-a2a5-fa19a61a5d28 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:08.569303 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b1ac8cf0-476d-433a-a2a5-fa19a61a5d28 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:08.711428 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b1ac8cf0-476d-433a-a2a5-fa19a61a5d28 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:08.719504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b1ac8cf0-476d-433a-a2a5-fa19a61a5d28 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d" status: 200 len: 1549 microversion: 2.1 time: 0.163921 May 26 12:42:08.720034 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 465/940] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:08 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:08.737418 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-c63df60a-8ee3-402b-8a17-7971953bb380 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:08.737992 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-c63df60a-8ee3-402b-8a17-7971953bb380 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:08.744927 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c63df60a-8ee3-402b-8a17-7971953bb380 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:08.748090 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c63df60a-8ee3-402b-8a17-7971953bb380 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:08.748863 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c63df60a-8ee3-402b-8a17-7971953bb380 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:08.749314 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c63df60a-8ee3-402b-8a17-7971953bb380 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:08.838088 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-c63df60a-8ee3-402b-8a17-7971953bb380 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103338 May 26 12:42:08.838088 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 476/941] 10.222.0.39 () {58 vars in 1274 bytes} [Thu May 26 12:42:08 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:42:08.888671 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-56248e95-00ed-4f8a-aaa4-884394bd4426 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:08.890687 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-56248e95-00ed-4f8a-aaa4-884394bd4426 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:08.897159 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-56248e95-00ed-4f8a-aaa4-884394bd4426 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:08.897739 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-56248e95-00ed-4f8a-aaa4-884394bd4426 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:08.898721 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-56248e95-00ed-4f8a-aaa4-884394bd4426 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:08.899378 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-56248e95-00ed-4f8a-aaa4-884394bd4426 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:08.933239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-56248e95-00ed-4f8a-aaa4-884394bd4426 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050002 May 26 12:42:08.933897 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 466/942] 10.222.0.39 () {58 vars in 1301 bytes} [Thu May 26 12:42:08 2022] GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:42:09.825818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-b33ecef2-e10f-4bb5-a87e-8066691f05c5 req-5dad5453-40d8-4e48-a450-e426502bb42e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "411d94dd-76cb-418b-bfac-d1948a57f92d", "tag": "b10bc25c-5ab6-4524-8866-5be0a8a8aad6"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:09.834452 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-b33ecef2-e10f-4bb5-a87e-8066691f05c5 req-5dad5453-40d8-4e48-a450-e426502bb42e service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:09.834905 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-b33ecef2-e10f-4bb5-a87e-8066691f05c5 req-5dad5453-40d8-4e48-a450-e426502bb42e service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:09.847413 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-b33ecef2-e10f-4bb5-a87e-8066691f05c5 req-5dad5453-40d8-4e48-a450-e426502bb42e service nova] Creating event network-changed:b10bc25c-5ab6-4524-8866-5be0a8a8aad6 for instance 411d94dd-76cb-418b-bfac-d1948a57f92d on hv-cinder-81514 May 26 12:42:09.852484 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-b33ecef2-e10f-4bb5-a87e-8066691f05c5 req-5dad5453-40d8-4e48-a450-e426502bb42e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030509 May 26 12:42:09.853859 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 477/943] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:42:09.945694 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-80e3b070-b31c-453c-b00e-3f5e6dbd2700 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:09.947428 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-80e3b070-b31c-453c-b00e-3f5e6dbd2700 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:09.988477 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-80e3b070-b31c-453c-b00e-3f5e6dbd2700 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:09.992933 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-80e3b070-b31c-453c-b00e-3f5e6dbd2700 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:09.994098 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-80e3b070-b31c-453c-b00e-3f5e6dbd2700 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:09.997257 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-80e3b070-b31c-453c-b00e-3f5e6dbd2700 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:10.073235 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-80e3b070-b31c-453c-b00e-3f5e6dbd2700 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.132043 May 26 12:42:10.074209 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 467/944] 10.222.0.39 () {58 vars in 1301 bytes} [Thu May 26 12:42:09 2022] GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f/os-volume_attachments => generated 25 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:42:10.153671 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-b43fd271-eb92-45a1-91f8-5017ad38d75c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:10.154322 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-b43fd271-eb92-45a1-91f8-5017ad38d75c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:10.170174 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b43fd271-eb92-45a1-91f8-5017ad38d75c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:10.170702 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b43fd271-eb92-45a1-91f8-5017ad38d75c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:10.172057 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b43fd271-eb92-45a1-91f8-5017ad38d75c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:10.172516 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b43fd271-eb92-45a1-91f8-5017ad38d75c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:10.205601 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-b43fd271-eb92-45a1-91f8-5017ad38d75c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Going to try to terminate instance {{(pid=124133) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:42:10.223399 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:10.318839 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-b43fd271-eb92-45a1-91f8-5017ad38d75c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f" status: 204 len: 0 microversion: 2.1 time: 0.168928 May 26 12:42:10.322823 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 478/945] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:42:10 2022] DELETE /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:42:10.332936 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-fa8e68c4-c4de-42cc-a378-85a2ce834a59 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:10.333472 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-fa8e68c4-c4de-42cc-a378-85a2ce834a59 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:10.342600 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fa8e68c4-c4de-42cc-a378-85a2ce834a59 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:10.343053 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fa8e68c4-c4de-42cc-a378-85a2ce834a59 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:10.344634 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fa8e68c4-c4de-42cc-a378-85a2ce834a59 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:10.345102 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fa8e68c4-c4de-42cc-a378-85a2ce834a59 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:10.524754 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-fa8e68c4-c4de-42cc-a378-85a2ce834a59 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:10.534997 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-fa8e68c4-c4de-42cc-a378-85a2ce834a59 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f" status: 200 len: 1680 microversion: 2.1 time: 0.206520 May 26 12:42:10.536460 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 468/946] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:10 2022] GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f => generated 1680 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:11.411502 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-259605fc-41c2-4dc6-9338-c383a8a00e72 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:11.412902 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-259605fc-41c2-4dc6-9338-c383a8a00e72 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:11.419788 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-259605fc-41c2-4dc6-9338-c383a8a00e72 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:11.420245 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-259605fc-41c2-4dc6-9338-c383a8a00e72 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:11.421108 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-259605fc-41c2-4dc6-9338-c383a8a00e72 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:11.422318 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-259605fc-41c2-4dc6-9338-c383a8a00e72 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:11.446227 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-259605fc-41c2-4dc6-9338-c383a8a00e72 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2/ips" status: 200 len: 152 microversion: 2.20 time: 0.039086 May 26 12:42:11.447660 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 479/947] 10.222.0.39 () {60 vars in 1288 bytes} [Thu May 26 12:42:11 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:42:11.553625 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-ec9792bc-79fe-4fbc-b4e4-4305a4af4253 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:11.554241 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-ec9792bc-79fe-4fbc-b4e4-4305a4af4253 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:11.561476 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ec9792bc-79fe-4fbc-b4e4-4305a4af4253 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:11.563032 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ec9792bc-79fe-4fbc-b4e4-4305a4af4253 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:11.564191 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ec9792bc-79fe-4fbc-b4e4-4305a4af4253 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:11.564638 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ec9792bc-79fe-4fbc-b4e4-4305a4af4253 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:11.777328 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ec9792bc-79fe-4fbc-b4e4-4305a4af4253 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:11.792980 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-ec9792bc-79fe-4fbc-b4e4-4305a4af4253 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f" status: 200 len: 1680 microversion: 2.1 time: 0.242821 May 26 12:42:11.804221 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 469/948] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:11 2022] GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f => generated 1680 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:12.811332 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-6abe8a64-abc5-468c-b926-bf5f540571be tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:12.811862 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-6abe8a64-abc5-468c-b926-bf5f540571be tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:12.821582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6abe8a64-abc5-468c-b926-bf5f540571be tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:12.825405 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6abe8a64-abc5-468c-b926-bf5f540571be tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:12.826851 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6abe8a64-abc5-468c-b926-bf5f540571be tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:12.827422 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6abe8a64-abc5-468c-b926-bf5f540571be tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:13.112470 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-6abe8a64-abc5-468c-b926-bf5f540571be tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:13.123098 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-6abe8a64-abc5-468c-b926-bf5f540571be tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f" status: 200 len: 1680 microversion: 2.1 time: 0.315978 May 26 12:42:13.126269 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 480/949] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:12 2022] GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f => generated 1680 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:13.418999 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-ea567ba3-1590-496f-8631-35e2585adac9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:13.420417 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-ea567ba3-1590-496f-8631-35e2585adac9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:13.428247 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:13.431872 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ea567ba3-1590-496f-8631-35e2585adac9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:13.432753 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ea567ba3-1590-496f-8631-35e2585adac9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:13.434526 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ea567ba3-1590-496f-8631-35e2585adac9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:13.435345 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ea567ba3-1590-496f-8631-35e2585adac9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:13.463240 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.objects.instance [None req-ea567ba3-1590-496f-8631-35e2585adac9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lazy-loading 'flavor' on Instance uuid f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 {{(pid=124134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:42:13.815777 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-df5b23c2-6bfb-4a93-b3fe-c058cbe966a9 req-3452affc-f7ee-458e-b77b-dc20945ebb93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0db35800-34bb-4fda-bbb9-971062a3b16f", "name": "network-vif-deleted", "tag": "6b85733d-334f-4218-a3f1-86407b989e88"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:13.820072 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:13.840899 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-df5b23c2-6bfb-4a93-b3fe-c058cbe966a9 req-3452affc-f7ee-458e-b77b-dc20945ebb93 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:13.841805 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-df5b23c2-6bfb-4a93-b3fe-c058cbe966a9 req-3452affc-f7ee-458e-b77b-dc20945ebb93 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:13.900184 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-df5b23c2-6bfb-4a93-b3fe-c058cbe966a9 req-3452affc-f7ee-458e-b77b-dc20945ebb93 service nova] Creating event network-vif-deleted:6b85733d-334f-4218-a3f1-86407b989e88 for instance 0db35800-34bb-4fda-bbb9-971062a3b16f on hv-cinder-81514 May 26 12:42:13.914290 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-df5b23c2-6bfb-4a93-b3fe-c058cbe966a9 req-3452affc-f7ee-458e-b77b-dc20945ebb93 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103498 May 26 12:42:13.917229 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 481/950] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:42:14.005869 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-ea567ba3-1590-496f-8631-35e2585adac9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "POST /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2/action" status: 202 len: 0 microversion: 2.20 time: 0.590473 May 26 12:42:14.009487 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 470/951] 10.222.0.39 () {62 vars in 1318 bytes} [Thu May 26 12:42:13 2022] POST /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2/action => generated 0 bytes in 595 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 12:42:14.020310 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ef2dae49-472c-45c9-b743-d2bd13a57827 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:14.021190 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ef2dae49-472c-45c9-b743-d2bd13a57827 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:14.040989 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ef2dae49-472c-45c9-b743-d2bd13a57827 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:14.041440 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ef2dae49-472c-45c9-b743-d2bd13a57827 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:14.053413 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ef2dae49-472c-45c9-b743-d2bd13a57827 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:14.054076 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ef2dae49-472c-45c9-b743-d2bd13a57827 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:14.143048 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-87b5f824-8dda-4b66-8a8c-7fb88f3b6ecf tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:14.143764 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-87b5f824-8dda-4b66-8a8c-7fb88f3b6ecf tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:14.152485 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-87b5f824-8dda-4b66-8a8c-7fb88f3b6ecf tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:14.152980 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-87b5f824-8dda-4b66-8a8c-7fb88f3b6ecf tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:14.153764 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-87b5f824-8dda-4b66-8a8c-7fb88f3b6ecf tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:14.154221 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-87b5f824-8dda-4b66-8a8c-7fb88f3b6ecf tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:14.194137 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-87b5f824-8dda-4b66-8a8c-7fb88f3b6ecf tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:14.194589 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-87b5f824-8dda-4b66-8a8c-7fb88f3b6ecf tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:14.195049 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.objects.instance [None req-87b5f824-8dda-4b66-8a8c-7fb88f3b6ecf tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lazy-loading 'fault' on Instance uuid 0db35800-34bb-4fda-bbb9-971062a3b16f {{(pid=124134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:42:14.245385 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-87b5f824-8dda-4b66-8a8c-7fb88f3b6ecf tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:14.254741 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-87b5f824-8dda-4b66-8a8c-7fb88f3b6ecf tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f" status: 200 len: 1331 microversion: 2.1 time: 0.117377 May 26 12:42:14.265767 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 471/952] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:14 2022] GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f => generated 1331 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:14.333609 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ef2dae49-472c-45c9-b743-d2bd13a57827 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:14.342880 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ef2dae49-472c-45c9-b743-d2bd13a57827 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:14.346349 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ef2dae49-472c-45c9-b743-d2bd13a57827 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:14.347911 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ef2dae49-472c-45c9-b743-d2bd13a57827 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1722 microversion: 2.20 time: 0.333742 May 26 12:42:14.361162 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 482/953] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:14 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1722 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:15.273473 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e421902f-7fb5-46de-889a-bd55daf97247 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:15.274202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-e421902f-7fb5-46de-889a-bd55daf97247 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:15.282897 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e421902f-7fb5-46de-889a-bd55daf97247 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:15.282897 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e421902f-7fb5-46de-889a-bd55daf97247 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:15.283905 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e421902f-7fb5-46de-889a-bd55daf97247 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:15.284647 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e421902f-7fb5-46de-889a-bd55daf97247 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:15.299992 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.wsgi [None req-e421902f-7fb5-46de-889a-bd55daf97247 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] HTTP exception thrown: Instance 0db35800-34bb-4fda-bbb9-971062a3b16f could not be found. May 26 12:42:15.301677 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e421902f-7fb5-46de-889a-bd55daf97247 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Request method failure captured: May 26 12:42:15.301677 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: request: GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f HTTP/1.1 May 26 12:42:15.301677 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept: application/json May 26 12:42:15.301677 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept-Encoding: identity May 26 12:42:15.301677 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Connection: close May 26 12:42:15.301677 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Length: 0 May 26 12:42:15.301677 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Type: application/json May 26 12:42:15.301677 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Host: 10.222.0.39 May 26 12:42:15.301677 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Openstack-System-Scope: None May 26 12:42:15.301677 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: User-Agent: python-urllib3/1.26.9 May 26 12:42:15.301677 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Auth-Token: gAAAAABij3NlvcGUyXKMcR3f44eTcb9KUX9Z1HAOP6nfmLvSlYo0JIjkhlxQnvnKs5YzuXlFyVI90MMwVyxF6G0XRw3coPQTRjw_l752cMl_otjGJnnaQ4RjUOg-dE0XHNrSgowu0nH-j9SReMVUJ7YwVfxzPS5nbVTF1HJ2aVri9hxI7XdrhVs May 26 12:42:15.301677 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Id: None May 26 12:42:15.301677 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Name: None May 26 12:42:15.301677 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Identity-Status: Confirmed May 26 12:42:15.301677 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Is-Admin-Project: True May 26 12:42:15.301677 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Id: default May 26 12:42:15.301677 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Name: Default May 26 12:42:15.301677 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:42:15.301677 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:42:15.301677 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Role: member,reader May 26 12:42:15.301677 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Roles: member,reader May 26 12:42:15.303036 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7ef656c0ca2943eb965bf10d4e943d27", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:42:15.303036 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:42:15.303036 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:42:15.303036 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:42:15.303036 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:42:15.303036 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Id: default May 26 12:42:15.303036 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Name: Default May 26 12:42:15.303036 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Id: 7b14606965a74c71881595c71bdd2d58 May 26 12:42:15.303036 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Name: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:42:15.303036 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: method: > May 26 12:42:15.303036 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: exception: Instance 0db35800-34bb-4fda-bbb9-971062a3b16f could not be found. May 26 12:42:15.303036 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: action_args: {'id': '0db35800-34bb-4fda-bbb9-971062a3b16f'} May 26 12:42:15.303818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:42:15.303818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:42:15.303818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:42:15.303818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:42:15.303818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:42:15.303818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:42:15.303818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:42:15.303818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:42:15.303818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:42:15.303818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:42:15.303818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0db35800-34bb-4fda-bbb9-971062a3b16f could not be found. May 26 12:42:15.303818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:42:15.303818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:42:15.303818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:42:15.303818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:42:15.303818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:42:15.303818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:42:15.303818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:42:15.303818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:42:15.303818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:42:15.305643 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:42:15.305643 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:42:15.305643 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:42:15.305643 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:42:15.305643 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:42:15.305643 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:42:15.305643 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:42:15.305643 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0db35800-34bb-4fda-bbb9-971062a3b16f could not be found. May 26 12:42:15.305643 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:42:15.305643 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:42:15.305643 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:42:15.305643 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:42:15.305643 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:42:15.305643 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:42:15.305643 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:42:15.305643 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:42:15.305643 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0db35800-34bb-4fda-bbb9-971062a3b16f could not be found. May 26 12:42:15.305643 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:42:15.306839 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e421902f-7fb5-46de-889a-bd55daf97247 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Returning 404 to user: Instance 0db35800-34bb-4fda-bbb9-971062a3b16f could not be found. {{(pid=124134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:42:15.306839 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-e421902f-7fb5-46de-889a-bd55daf97247 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f" status: 404 len: 111 microversion: 2.1 time: 0.033949 May 26 12:42:15.306839 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 472/954] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:15 2022] GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:42:15.312952 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-c08293db-d014-4a74-b988-a92181592af5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '.version_select at 0x7fed314b6280>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:15.334455 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-c08293db-d014-4a74-b988-a92181592af5 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-538801290" status: 202 len: 0 microversion: 2.1 time: 0.025734 May 26 12:42:15.335137 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 483/955] 10.222.0.39 () {58 vars in 1217 bytes} [Thu May 26 12:42:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-538801290 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:42:15.370995 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-8a5f3f52-2fe8-4d30-ba78-a09067189db3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:15.371927 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-8a5f3f52-2fe8-4d30-ba78-a09067189db3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:15.379681 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8a5f3f52-2fe8-4d30-ba78-a09067189db3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:15.380407 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8a5f3f52-2fe8-4d30-ba78-a09067189db3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:15.382153 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8a5f3f52-2fe8-4d30-ba78-a09067189db3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:15.382966 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8a5f3f52-2fe8-4d30-ba78-a09067189db3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:15.628478 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-8a5f3f52-2fe8-4d30-ba78-a09067189db3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:15.672273 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-8a5f3f52-2fe8-4d30-ba78-a09067189db3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:15.674086 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-8a5f3f52-2fe8-4d30-ba78-a09067189db3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:15.675337 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-8a5f3f52-2fe8-4d30-ba78-a09067189db3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1722 microversion: 2.20 time: 0.308626 May 26 12:42:15.675895 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 473/956] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:15 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1722 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:16.148123 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-02594024-0fda-4e9e-878a-1b9090499681 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Action: 'create', calling method: .version_select at 0x7fed31539280>, body: {"keypair": {"name": "tempest-keypair-1147267048", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoe6/s32NMZ9RHJIPego28PKYvrFL+ZYxtMMef24vpcxfqP0205l/z/WzbGEnhlGwUfCZGf0iXyV+p1lFru6522ZI2i1prUOkCFYTPUFFoYYCjDZ1TrttqTU7eiFKToRg=="}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:16.172667 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-02594024-0fda-4e9e-878a-1b9090499681 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Getting quotas for project 7ef656c0ca2943eb965bf10d4e943d27. Resources: {'key_pairs'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:42:16.177880 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-02594024-0fda-4e9e-878a-1b9090499681 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Getting quotas for user 7b14606965a74c71881595c71bdd2d58 and project 7ef656c0ca2943eb965bf10d4e943d27. Resources: {'key_pairs'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:42:16.211749 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-02594024-0fda-4e9e-878a-1b9090499681 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.068654 May 26 12:42:16.212735 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 484/957] 10.222.0.39 () {60 vars in 1158 bytes} [Thu May 26 12:42:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:42:16.709637 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-d9679a38-0da5-4ffa-aec7-43d88a2cc53c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:16.711002 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-d9679a38-0da5-4ffa-aec7-43d88a2cc53c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:16.724741 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d9679a38-0da5-4ffa-aec7-43d88a2cc53c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:16.725489 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d9679a38-0da5-4ffa-aec7-43d88a2cc53c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:16.726455 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d9679a38-0da5-4ffa-aec7-43d88a2cc53c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:16.727087 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d9679a38-0da5-4ffa-aec7-43d88a2cc53c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:16.991489 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d9679a38-0da5-4ffa-aec7-43d88a2cc53c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:17.000184 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d9679a38-0da5-4ffa-aec7-43d88a2cc53c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:17.002315 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d9679a38-0da5-4ffa-aec7-43d88a2cc53c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:17.003739 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-d9679a38-0da5-4ffa-aec7-43d88a2cc53c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1722 microversion: 2.20 time: 0.310276 May 26 12:42:17.014872 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 474/958] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:16 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1722 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:18.023567 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-a0a00eee-f854-44d3-914c-ef4a4d5f5234 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:18.024202 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-a0a00eee-f854-44d3-914c-ef4a4d5f5234 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:18.043108 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a0a00eee-f854-44d3-914c-ef4a4d5f5234 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:18.043859 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a0a00eee-f854-44d3-914c-ef4a4d5f5234 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:18.044898 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a0a00eee-f854-44d3-914c-ef4a4d5f5234 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:18.045512 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a0a00eee-f854-44d3-914c-ef4a4d5f5234 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:18.326944 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-d9792b5a-ff02-4f16-800f-16a8ef57327c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1500212728", "imageRef": "7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b932a260-099c-4abe-98f7-c68e5fa9337e"}], "security_groups": [{"name": "tempest-securitygroup--194796077"}], "key_name": "tempest-keypair-1147267048", "user_data": "}} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:18.637131 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.network.neutron [None req-d9792b5a-ff02-4f16-800f-16a8ef57327c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] validate_networks() for [('b932a260-099c-4abe-98f7-c68e5fa9337e', None, None, None, None, None)] {{(pid=124134) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:42:18.785155 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-a0a00eee-f854-44d3-914c-ef4a4d5f5234 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:18.796724 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-a0a00eee-f854-44d3-914c-ef4a4d5f5234 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:18.798264 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-a0a00eee-f854-44d3-914c-ef4a4d5f5234 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:18.799941 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-a0a00eee-f854-44d3-914c-ef4a4d5f5234 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1722 microversion: 2.20 time: 0.781196 May 26 12:42:18.810953 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 485/959] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:18 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1722 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:19.539674 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-d9792b5a-ff02-4f16-800f-16a8ef57327c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Flavor limits 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:42:19.540832 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-d9792b5a-ff02-4f16-800f-16a8ef57327c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Image limits 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:42:19.541429 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-d9792b5a-ff02-4f16-800f-16a8ef57327c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Flavor pref 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:42:19.541843 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-d9792b5a-ff02-4f16-800f-16a8ef57327c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Image pref 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:42:19.542854 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-d9792b5a-ff02-4f16-800f-16a8ef57327c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:42:19.556749 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d9792b5a-ff02-4f16-800f-16a8ef57327c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:19.557430 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d9792b5a-ff02-4f16-800f-16a8ef57327c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:19.558417 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d9792b5a-ff02-4f16-800f-16a8ef57327c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:19.559040 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d9792b5a-ff02-4f16-800f-16a8ef57327c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:19.599672 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.quota [None req-d9792b5a-ff02-4f16-800f-16a8ef57327c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Getting quotas for project 7ef656c0ca2943eb965bf10d4e943d27. Resources: {'cores', 'instances', 'ram'} {{(pid=124134) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:42:19.605450 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.quota [None req-d9792b5a-ff02-4f16-800f-16a8ef57327c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Getting quotas for user 7b14606965a74c71881595c71bdd2d58 and project 7ef656c0ca2943eb965bf10d4e943d27. Resources: {'cores', 'instances', 'ram'} {{(pid=124134) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:42:19.620263 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-d9792b5a-ff02-4f16-800f-16a8ef57327c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Going to run 1 instances... {{(pid=124134) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:42:19.624059 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-d9792b5a-ff02-4f16-800f-16a8ef57327c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:42:19.685417 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-d9792b5a-ff02-4f16-800f-16a8ef57327c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.363559 May 26 12:42:19.686215 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 475/960] 10.222.0.39 () {60 vars in 1146 bytes} [Thu May 26 12:42:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 1365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:42:19.697097 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-1be57c9c-6879-439e-a8cc-9e9713f46ea4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:19.698317 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-1be57c9c-6879-439e-a8cc-9e9713f46ea4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:19.786353 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-1be57c9c-6879-439e-a8cc-9e9713f46ea4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:19.793799 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-1be57c9c-6879-439e-a8cc-9e9713f46ea4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6" status: 200 len: 1242 microversion: 2.1 time: 0.101184 May 26 12:42:19.794574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 486/961] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:19 2022] GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6 => generated 1242 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:19.818511 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-56ff0e6a-a2f9-47e3-927d-1de6f99a8c84 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:19.819118 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-56ff0e6a-a2f9-47e3-927d-1de6f99a8c84 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:19.826229 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-56ff0e6a-a2f9-47e3-927d-1de6f99a8c84 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:19.827238 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-56ff0e6a-a2f9-47e3-927d-1de6f99a8c84 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:19.829268 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-56ff0e6a-a2f9-47e3-927d-1de6f99a8c84 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:19.830014 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-56ff0e6a-a2f9-47e3-927d-1de6f99a8c84 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:20.028818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-56ff0e6a-a2f9-47e3-927d-1de6f99a8c84 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:20.038183 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-56ff0e6a-a2f9-47e3-927d-1de6f99a8c84 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:20.039815 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-56ff0e6a-a2f9-47e3-927d-1de6f99a8c84 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:20.041179 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-56ff0e6a-a2f9-47e3-927d-1de6f99a8c84 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1722 microversion: 2.20 time: 0.226681 May 26 12:42:20.041974 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 476/962] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:19 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:20.811254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ad942fe5-ef98-4298-bc84-4e60b9c3ef37 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:20.812537 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ad942fe5-ef98-4298-bc84-4e60b9c3ef37 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:20.823781 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ad942fe5-ef98-4298-bc84-4e60b9c3ef37 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:20.824473 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ad942fe5-ef98-4298-bc84-4e60b9c3ef37 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:20.825494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ad942fe5-ef98-4298-bc84-4e60b9c3ef37 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:20.826095 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ad942fe5-ef98-4298-bc84-4e60b9c3ef37 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:20.972549 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ad942fe5-ef98-4298-bc84-4e60b9c3ef37 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:20.981641 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ad942fe5-ef98-4298-bc84-4e60b9c3ef37 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6" status: 200 len: 1302 microversion: 2.1 time: 0.174134 May 26 12:42:20.982445 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 487/963] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:20 2022] GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6 => generated 1302 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:21.068106 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f61aac02-95da-4129-9bb6-74322349b4c6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:21.071951 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-f61aac02-95da-4129-9bb6-74322349b4c6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:21.081904 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f61aac02-95da-4129-9bb6-74322349b4c6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:21.082543 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f61aac02-95da-4129-9bb6-74322349b4c6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:21.083494 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f61aac02-95da-4129-9bb6-74322349b4c6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:21.084085 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f61aac02-95da-4129-9bb6-74322349b4c6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:21.320995 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-f61aac02-95da-4129-9bb6-74322349b4c6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:21.331620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-f61aac02-95da-4129-9bb6-74322349b4c6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:21.333463 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-f61aac02-95da-4129-9bb6-74322349b4c6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:21.335044 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-f61aac02-95da-4129-9bb6-74322349b4c6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1722 microversion: 2.20 time: 0.277224 May 26 12:42:21.341512 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 477/964] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:21 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:21.998989 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-525b33ba-0669-4085-9933-8d2b99e0d55d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:21.999648 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-525b33ba-0669-4085-9933-8d2b99e0d55d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:22.006079 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-525b33ba-0669-4085-9933-8d2b99e0d55d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:22.006880 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-525b33ba-0669-4085-9933-8d2b99e0d55d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:22.007296 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-525b33ba-0669-4085-9933-8d2b99e0d55d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:22.007734 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-525b33ba-0669-4085-9933-8d2b99e0d55d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:22.265888 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-525b33ba-0669-4085-9933-8d2b99e0d55d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:22.280033 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-525b33ba-0669-4085-9933-8d2b99e0d55d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6" status: 200 len: 1367 microversion: 2.1 time: 0.284786 May 26 12:42:22.281340 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 488/965] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:21 2022] GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6 => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:22.353973 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-bca0283b-367a-43fc-9b47-b1952209765b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:22.354587 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-bca0283b-367a-43fc-9b47-b1952209765b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:22.361951 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bca0283b-367a-43fc-9b47-b1952209765b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:22.371553 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bca0283b-367a-43fc-9b47-b1952209765b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:22.372736 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bca0283b-367a-43fc-9b47-b1952209765b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:22.373348 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bca0283b-367a-43fc-9b47-b1952209765b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:22.963903 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-bca0283b-367a-43fc-9b47-b1952209765b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:22.986621 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-bca0283b-367a-43fc-9b47-b1952209765b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:22.988840 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-bca0283b-367a-43fc-9b47-b1952209765b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:22.993433 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-bca0283b-367a-43fc-9b47-b1952209765b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1722 microversion: 2.20 time: 0.640341 May 26 12:42:22.994844 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 478/966] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:22 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1722 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:23.298262 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-be763176-9f27-4676-a5b2-520bdae6d638 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:23.298882 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-be763176-9f27-4676-a5b2-520bdae6d638 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:23.310535 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-be763176-9f27-4676-a5b2-520bdae6d638 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:23.313971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-be763176-9f27-4676-a5b2-520bdae6d638 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:23.315490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-be763176-9f27-4676-a5b2-520bdae6d638 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:23.316166 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-be763176-9f27-4676-a5b2-520bdae6d638 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:23.488432 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-cee7ab75-cd09-458e-b53b-47cd6eb75781 req-1b7c09cc-8df0-4e17-bfb4-6eafee74d0a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6569d326-c20a-4044-89b6-db08739f36f6", "tag": "a9732a91-5268-4fd5-8f72-233936555083"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:23.512613 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-cee7ab75-cd09-458e-b53b-47cd6eb75781 req-1b7c09cc-8df0-4e17-bfb4-6eafee74d0a1 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:23.527900 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-cee7ab75-cd09-458e-b53b-47cd6eb75781 req-1b7c09cc-8df0-4e17-bfb4-6eafee74d0a1 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:23.544635 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-cee7ab75-cd09-458e-b53b-47cd6eb75781 req-1b7c09cc-8df0-4e17-bfb4-6eafee74d0a1 service nova] Creating event network-changed:a9732a91-5268-4fd5-8f72-233936555083 for instance 6569d326-c20a-4044-89b6-db08739f36f6 on hv-cinder-81514 May 26 12:42:23.554327 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-cee7ab75-cd09-458e-b53b-47cd6eb75781 req-1b7c09cc-8df0-4e17-bfb4-6eafee74d0a1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072578 May 26 12:42:23.555505 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 479/967] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:42:23.662032 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-be763176-9f27-4676-a5b2-520bdae6d638 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:23.675575 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-be763176-9f27-4676-a5b2-520bdae6d638 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6" status: 200 len: 1367 microversion: 2.1 time: 0.376419 May 26 12:42:23.676567 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 489/968] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:23 2022] GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6 => generated 1367 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:24.013096 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b722bffc-c897-47cd-8dde-8b87efb7aa72 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:24.013682 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b722bffc-c897-47cd-8dde-8b87efb7aa72 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:24.025759 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b722bffc-c897-47cd-8dde-8b87efb7aa72 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:24.026588 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b722bffc-c897-47cd-8dde-8b87efb7aa72 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:24.027587 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b722bffc-c897-47cd-8dde-8b87efb7aa72 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:24.028250 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b722bffc-c897-47cd-8dde-8b87efb7aa72 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:24.311906 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b722bffc-c897-47cd-8dde-8b87efb7aa72 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:24.319642 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:24.326048 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b722bffc-c897-47cd-8dde-8b87efb7aa72 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:24.338270 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b722bffc-c897-47cd-8dde-8b87efb7aa72 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:24.339967 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b722bffc-c897-47cd-8dde-8b87efb7aa72 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1722 microversion: 2.20 time: 0.331251 May 26 12:42:24.343012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 480/969] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:24 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1722 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:24.694648 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-06240066-12ae-4aef-92d5-d26a1b0a4817 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:24.695914 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-06240066-12ae-4aef-92d5-d26a1b0a4817 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:24.710641 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-06240066-12ae-4aef-92d5-d26a1b0a4817 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:24.714456 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-06240066-12ae-4aef-92d5-d26a1b0a4817 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:24.715502 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-06240066-12ae-4aef-92d5-d26a1b0a4817 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:24.717648 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-06240066-12ae-4aef-92d5-d26a1b0a4817 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:24.906022 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-06240066-12ae-4aef-92d5-d26a1b0a4817 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:24.917211 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-06240066-12ae-4aef-92d5-d26a1b0a4817 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6" status: 200 len: 1367 microversion: 2.1 time: 0.226995 May 26 12:42:24.919203 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 490/970] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:24 2022] GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:25.361912 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-aa57ee46-f973-4541-b5f8-6b53cfa5597e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:25.363166 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-aa57ee46-f973-4541-b5f8-6b53cfa5597e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:25.371818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-aa57ee46-f973-4541-b5f8-6b53cfa5597e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:25.372520 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-aa57ee46-f973-4541-b5f8-6b53cfa5597e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:25.373515 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-aa57ee46-f973-4541-b5f8-6b53cfa5597e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:25.374120 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-aa57ee46-f973-4541-b5f8-6b53cfa5597e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:25.548646 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-aa57ee46-f973-4541-b5f8-6b53cfa5597e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:25.558097 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-aa57ee46-f973-4541-b5f8-6b53cfa5597e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:25.560176 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-aa57ee46-f973-4541-b5f8-6b53cfa5597e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:25.561495 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-aa57ee46-f973-4541-b5f8-6b53cfa5597e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1722 microversion: 2.20 time: 0.204432 May 26 12:42:25.562401 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 481/971] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:25 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:25.935378 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-fa0e23af-fd8f-4b46-a710-ffd136769d07 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:25.936000 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-fa0e23af-fd8f-4b46-a710-ffd136769d07 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:25.951253 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fa0e23af-fd8f-4b46-a710-ffd136769d07 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:25.951706 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fa0e23af-fd8f-4b46-a710-ffd136769d07 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:25.953063 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fa0e23af-fd8f-4b46-a710-ffd136769d07 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:25.954618 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fa0e23af-fd8f-4b46-a710-ffd136769d07 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:26.357337 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-fa0e23af-fd8f-4b46-a710-ffd136769d07 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:26.365529 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-fa0e23af-fd8f-4b46-a710-ffd136769d07 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6" status: 200 len: 1367 microversion: 2.1 time: 0.434001 May 26 12:42:26.366987 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 491/972] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:25 2022] GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6 => generated 1367 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:26.580633 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-853197f8-8d08-472c-a044-b233903cc9ef tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:26.581282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-853197f8-8d08-472c-a044-b233903cc9ef tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:26.598335 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-853197f8-8d08-472c-a044-b233903cc9ef tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:26.598703 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-853197f8-8d08-472c-a044-b233903cc9ef tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:26.599485 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-853197f8-8d08-472c-a044-b233903cc9ef tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:26.599926 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-853197f8-8d08-472c-a044-b233903cc9ef tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:26.833213 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-853197f8-8d08-472c-a044-b233903cc9ef tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:26.847724 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-853197f8-8d08-472c-a044-b233903cc9ef tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:26.849500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-853197f8-8d08-472c-a044-b233903cc9ef tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:26.850927 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-853197f8-8d08-472c-a044-b233903cc9ef tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1722 microversion: 2.20 time: 0.274959 May 26 12:42:26.853084 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 482/973] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:26 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:27.385605 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f2d33c58-9ea2-4009-a3ea-20f38cacdd21 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:27.397348 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f2d33c58-9ea2-4009-a3ea-20f38cacdd21 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:27.404576 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f2d33c58-9ea2-4009-a3ea-20f38cacdd21 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:27.405055 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f2d33c58-9ea2-4009-a3ea-20f38cacdd21 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:27.405843 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f2d33c58-9ea2-4009-a3ea-20f38cacdd21 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:27.406415 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f2d33c58-9ea2-4009-a3ea-20f38cacdd21 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:27.582079 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f2d33c58-9ea2-4009-a3ea-20f38cacdd21 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:27.590026 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f2d33c58-9ea2-4009-a3ea-20f38cacdd21 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6" status: 200 len: 1367 microversion: 2.1 time: 0.208395 May 26 12:42:27.599241 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 492/974] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:27 2022] GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:27.876431 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e6e5dba8-05bb-401f-87c2-5cf3d224c1ba tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:27.881461 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-e6e5dba8-05bb-401f-87c2-5cf3d224c1ba tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:27.905152 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e6e5dba8-05bb-401f-87c2-5cf3d224c1ba tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:27.909155 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e6e5dba8-05bb-401f-87c2-5cf3d224c1ba tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:27.910317 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e6e5dba8-05bb-401f-87c2-5cf3d224c1ba tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:27.910975 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e6e5dba8-05bb-401f-87c2-5cf3d224c1ba tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:28.133409 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-e6e5dba8-05bb-401f-87c2-5cf3d224c1ba tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:28.143811 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-e6e5dba8-05bb-401f-87c2-5cf3d224c1ba tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:28.146337 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-e6e5dba8-05bb-401f-87c2-5cf3d224c1ba tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:28.147709 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-e6e5dba8-05bb-401f-87c2-5cf3d224c1ba tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1743 microversion: 2.20 time: 0.280428 May 26 12:42:28.159412 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 483/975] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:27 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1743 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:28.634018 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-bfa0bbd8-3f98-4bbb-8eec-840007604155 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:28.634018 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-bfa0bbd8-3f98-4bbb-8eec-840007604155 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:28.634018 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bfa0bbd8-3f98-4bbb-8eec-840007604155 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:28.634018 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bfa0bbd8-3f98-4bbb-8eec-840007604155 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:28.635476 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bfa0bbd8-3f98-4bbb-8eec-840007604155 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:28.635476 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bfa0bbd8-3f98-4bbb-8eec-840007604155 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:28.786327 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-bfa0bbd8-3f98-4bbb-8eec-840007604155 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:28.794803 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-bfa0bbd8-3f98-4bbb-8eec-840007604155 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6" status: 200 len: 1367 microversion: 2.1 time: 0.191165 May 26 12:42:28.795567 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 493/976] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:28 2022] GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:29.168412 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6b13262a-a2ec-4d78-80c9-e955f748fc35 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:29.168999 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-6b13262a-a2ec-4d78-80c9-e955f748fc35 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:29.177329 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6b13262a-a2ec-4d78-80c9-e955f748fc35 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:29.178051 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6b13262a-a2ec-4d78-80c9-e955f748fc35 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:29.178820 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6b13262a-a2ec-4d78-80c9-e955f748fc35 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:29.179255 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6b13262a-a2ec-4d78-80c9-e955f748fc35 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:29.344451 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-6b13262a-a2ec-4d78-80c9-e955f748fc35 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:29.356740 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-6b13262a-a2ec-4d78-80c9-e955f748fc35 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:29.362925 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-6b13262a-a2ec-4d78-80c9-e955f748fc35 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:29.362925 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-6b13262a-a2ec-4d78-80c9-e955f748fc35 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1743 microversion: 2.20 time: 0.198779 May 26 12:42:29.374126 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 484/977] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:29 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1743 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:29.815134 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-1a227dc7-b5bb-47a0-a315-c07513802746 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:29.816430 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-1a227dc7-b5bb-47a0-a315-c07513802746 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:29.829117 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=6 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:29.831970 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1a227dc7-b5bb-47a0-a315-c07513802746 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:29.832433 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1a227dc7-b5bb-47a0-a315-c07513802746 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:29.834416 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1a227dc7-b5bb-47a0-a315-c07513802746 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:29.835065 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1a227dc7-b5bb-47a0-a315-c07513802746 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:30.017266 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-1a227dc7-b5bb-47a0-a315-c07513802746 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:30.025638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-1a227dc7-b5bb-47a0-a315-c07513802746 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6" status: 200 len: 1367 microversion: 2.1 time: 0.216189 May 26 12:42:30.029980 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 494/978] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:29 2022] GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:30.252571 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-a291d715-9b16-4815-8940-590680dbb5ed req-090907dd-3c85-4ca8-89ad-5a15d2821ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2", "name": "network-vif-plugged", "status": "completed", "tag": "c3caaa3d-4347-42cd-a614-454eabf81b41"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:30.267097 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell0:SELECT=2 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:30.268784 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell0:SELECT=6 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:30.271938 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-a291d715-9b16-4815-8940-590680dbb5ed req-090907dd-3c85-4ca8-89ad-5a15d2821ef4 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:30.273046 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-a291d715-9b16-4815-8940-590680dbb5ed req-090907dd-3c85-4ca8-89ad-5a15d2821ef4 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:30.295377 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-a291d715-9b16-4815-8940-590680dbb5ed req-090907dd-3c85-4ca8-89ad-5a15d2821ef4 service nova] Creating event network-vif-plugged:c3caaa3d-4347-42cd-a614-454eabf81b41 for instance f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 on hv-cinder-81514 May 26 12:42:30.303566 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-a291d715-9b16-4815-8940-590680dbb5ed req-090907dd-3c85-4ca8-89ad-5a15d2821ef4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061764 May 26 12:42:30.304917 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 485/979] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:42:30.381161 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-387556c2-0078-4f4a-a18e-49127919860b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:30.381771 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-387556c2-0078-4f4a-a18e-49127919860b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:30.403956 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-387556c2-0078-4f4a-a18e-49127919860b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:30.404417 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-387556c2-0078-4f4a-a18e-49127919860b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:30.405264 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-387556c2-0078-4f4a-a18e-49127919860b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:30.406250 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-387556c2-0078-4f4a-a18e-49127919860b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:30.616776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-387556c2-0078-4f4a-a18e-49127919860b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:30.628308 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-387556c2-0078-4f4a-a18e-49127919860b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:30.629866 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-387556c2-0078-4f4a-a18e-49127919860b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:30.631083 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-387556c2-0078-4f4a-a18e-49127919860b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1743 microversion: 2.20 time: 0.253831 May 26 12:42:30.631639 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 495/980] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:30 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1743 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:31.044166 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-16d71a19-6ba0-429a-8159-b3c920d3822b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:31.045355 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-16d71a19-6ba0-429a-8159-b3c920d3822b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:31.061486 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-16d71a19-6ba0-429a-8159-b3c920d3822b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:31.062314 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-16d71a19-6ba0-429a-8159-b3c920d3822b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:31.072453 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-16d71a19-6ba0-429a-8159-b3c920d3822b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:31.073023 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-16d71a19-6ba0-429a-8159-b3c920d3822b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:31.268877 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-16d71a19-6ba0-429a-8159-b3c920d3822b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:31.277948 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-16d71a19-6ba0-429a-8159-b3c920d3822b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6" status: 200 len: 1367 microversion: 2.1 time: 0.238271 May 26 12:42:31.278501 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 486/981] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:31 2022] GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:31.650078 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-97794d90-1ace-4b6f-8b38-5f9b67716d9d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:31.651301 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-97794d90-1ace-4b6f-8b38-5f9b67716d9d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:31.658876 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-97794d90-1ace-4b6f-8b38-5f9b67716d9d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:31.659327 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-97794d90-1ace-4b6f-8b38-5f9b67716d9d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:31.660102 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-97794d90-1ace-4b6f-8b38-5f9b67716d9d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:31.660739 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-97794d90-1ace-4b6f-8b38-5f9b67716d9d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:31.807421 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-97794d90-1ace-4b6f-8b38-5f9b67716d9d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:31.816919 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-97794d90-1ace-4b6f-8b38-5f9b67716d9d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:31.818703 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-97794d90-1ace-4b6f-8b38-5f9b67716d9d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:31.820015 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-97794d90-1ace-4b6f-8b38-5f9b67716d9d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1743 microversion: 2.20 time: 0.173994 May 26 12:42:31.820637 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 496/982] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:31 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:42:32.097837 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-4bea185e-31eb-4a59-a3a5-cdddf0d0036b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Action: 'create', calling method: .version_select at 0x7fed31e09ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1098404276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3uLKAk1PxLh4h/f8zndJl99mKcnBVqHF/NYDyq30ySHpjLvcTdCrDb0AkCQyJmWiXFvMtUhRH7l4ppR0BjxioKNvw9JlVX8WkvlPm3NnANtTmbqKysINjLNnz/rxzlFA=="}} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:32.114773 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.quota [None req-4bea185e-31eb-4a59-a3a5-cdddf0d0036b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Getting quotas for project 91ce6c14fb95466dab6338cd0fafcd0e. Resources: {'key_pairs'} {{(pid=124134) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:42:32.118571 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.quota [None req-4bea185e-31eb-4a59-a3a5-cdddf0d0036b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Getting quotas for user 7ff0a10504ef4323a853d5f721c05299 and project 91ce6c14fb95466dab6338cd0fafcd0e. Resources: {'key_pairs'} {{(pid=124134) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:42:32.140705 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-4bea185e-31eb-4a59-a3a5-cdddf0d0036b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.048705 May 26 12:42:32.141443 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 487/983] 10.222.0.39 () {60 vars in 1158 bytes} [Thu May 26 12:42:32 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:42:32.191793 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e6b4c3fa-e322-4ebe-b50b-399559ac8f27 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-206913061", "imageRef": "d24cf9bb-63b9-4f8f-8e9b-f3d9c23d25b1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1098404276", "networks": [{"uuid": "5f0ecf8e-4a71-4b05-96ac-25c79e5107cc"}]}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:32.243071 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.network.neutron [None req-e6b4c3fa-e322-4ebe-b50b-399559ac8f27 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] validate_networks() for [('5f0ecf8e-4a71-4b05-96ac-25c79e5107cc', None, None, None, None, None)] {{(pid=124133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:42:32.295372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-fedbf294-ab28-4a9c-9fbe-5b29168a31dd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:32.295917 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-fedbf294-ab28-4a9c-9fbe-5b29168a31dd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:32.302473 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fedbf294-ab28-4a9c-9fbe-5b29168a31dd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:32.302946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fedbf294-ab28-4a9c-9fbe-5b29168a31dd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:32.303706 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fedbf294-ab28-4a9c-9fbe-5b29168a31dd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:32.304139 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fedbf294-ab28-4a9c-9fbe-5b29168a31dd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:32.501365 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-fedbf294-ab28-4a9c-9fbe-5b29168a31dd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:32.508700 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-fedbf294-ab28-4a9c-9fbe-5b29168a31dd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6" status: 200 len: 1367 microversion: 2.1 time: 0.217825 May 26 12:42:32.509588 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 488/984] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:32 2022] GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:32.672957 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-e6b4c3fa-e322-4ebe-b50b-399559ac8f27 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Flavor limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:42:32.673453 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-e6b4c3fa-e322-4ebe-b50b-399559ac8f27 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Image limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:42:32.673847 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-e6b4c3fa-e322-4ebe-b50b-399559ac8f27 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Flavor pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:42:32.674256 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-e6b4c3fa-e322-4ebe-b50b-399559ac8f27 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Image pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:42:32.674668 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-e6b4c3fa-e322-4ebe-b50b-399559ac8f27 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:42:32.684443 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e6b4c3fa-e322-4ebe-b50b-399559ac8f27 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:32.685067 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e6b4c3fa-e322-4ebe-b50b-399559ac8f27 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:32.686404 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e6b4c3fa-e322-4ebe-b50b-399559ac8f27 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:32.686739 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e6b4c3fa-e322-4ebe-b50b-399559ac8f27 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:32.703666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-e6b4c3fa-e322-4ebe-b50b-399559ac8f27 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Getting quotas for project 91ce6c14fb95466dab6338cd0fafcd0e. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:42:32.708498 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-e6b4c3fa-e322-4ebe-b50b-399559ac8f27 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Getting quotas for user 7ff0a10504ef4323a853d5f721c05299 and project 91ce6c14fb95466dab6338cd0fafcd0e. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:42:32.720348 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e6b4c3fa-e322-4ebe-b50b-399559ac8f27 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Going to run 1 instances... {{(pid=124133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:42:32.722607 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e6b4c3fa-e322-4ebe-b50b-399559ac8f27 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d24cf9bb-63b9-4f8f-8e9b-f3d9c23d25b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:42:32.767151 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e6b4c3fa-e322-4ebe-b50b-399559ac8f27 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.579236 May 26 12:42:32.767794 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 497/985] 10.222.0.39 () {60 vars in 1146 bytes} [Thu May 26 12:42:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 12:42:32.777629 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-2600bfaa-eb56-4bcd-8534-58da202f814e tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:32.778245 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-2600bfaa-eb56-4bcd-8534-58da202f814e tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:32.837760 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2600bfaa-eb56-4bcd-8534-58da202f814e tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:32.839658 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-5fdedcbd-16fb-4198-b0cb-4dbb4b8d19f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:32.840724 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-5fdedcbd-16fb-4198-b0cb-4dbb4b8d19f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:32.845002 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-2600bfaa-eb56-4bcd-8534-58da202f814e tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1258 microversion: 2.1 time: 0.071123 May 26 12:42:32.845734 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 489/986] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:32 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:32.852834 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5fdedcbd-16fb-4198-b0cb-4dbb4b8d19f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:32.853453 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5fdedcbd-16fb-4198-b0cb-4dbb4b8d19f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:32.854527 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5fdedcbd-16fb-4198-b0cb-4dbb4b8d19f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:32.854981 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5fdedcbd-16fb-4198-b0cb-4dbb4b8d19f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:33.010728 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-5fdedcbd-16fb-4198-b0cb-4dbb4b8d19f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:33.014705 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:33.021402 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-5fdedcbd-16fb-4198-b0cb-4dbb4b8d19f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:33.022933 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-5fdedcbd-16fb-4198-b0cb-4dbb4b8d19f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:33.024319 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-5fdedcbd-16fb-4198-b0cb-4dbb4b8d19f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1743 microversion: 2.20 time: 0.188726 May 26 12:42:33.024706 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 498/987] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:32 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1743 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:42:33.076496 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-858cc787-c9ad-4240-ac1e-c65c5e0dede6 req-4a1154d4-7e60-4287-a062-ef6368a8aaab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6569d326-c20a-4044-89b6-db08739f36f6", "name": "network-vif-plugged", "status": "completed", "tag": "a9732a91-5268-4fd5-8f72-233936555083"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:33.090378 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-858cc787-c9ad-4240-ac1e-c65c5e0dede6 req-4a1154d4-7e60-4287-a062-ef6368a8aaab service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:33.090848 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-858cc787-c9ad-4240-ac1e-c65c5e0dede6 req-4a1154d4-7e60-4287-a062-ef6368a8aaab service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:33.103262 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-858cc787-c9ad-4240-ac1e-c65c5e0dede6 req-4a1154d4-7e60-4287-a062-ef6368a8aaab service nova] Creating event network-vif-plugged:a9732a91-5268-4fd5-8f72-233936555083 for instance 6569d326-c20a-4044-89b6-db08739f36f6 on hv-cinder-81514 May 26 12:42:33.110449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-858cc787-c9ad-4240-ac1e-c65c5e0dede6 req-4a1154d4-7e60-4287-a062-ef6368a8aaab service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037243 May 26 12:42:33.111754 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 490/988] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:42:33.527358 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-221eb45c-a8bc-4263-b843-41412a53ffd0 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:33.527959 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-221eb45c-a8bc-4263-b843-41412a53ffd0 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:33.535567 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-221eb45c-a8bc-4263-b843-41412a53ffd0 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:33.536018 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-221eb45c-a8bc-4263-b843-41412a53ffd0 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:33.536794 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-221eb45c-a8bc-4263-b843-41412a53ffd0 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:33.537235 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-221eb45c-a8bc-4263-b843-41412a53ffd0 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:33.669896 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-221eb45c-a8bc-4263-b843-41412a53ffd0 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:33.677550 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-221eb45c-a8bc-4263-b843-41412a53ffd0 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6" status: 200 len: 1367 microversion: 2.1 time: 0.154775 May 26 12:42:33.678169 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 499/989] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:33 2022] GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:33.863473 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-afcce03f-6f9f-4105-8912-e94376cd1ce3 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:33.864272 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-afcce03f-6f9f-4105-8912-e94376cd1ce3 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:33.870796 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-afcce03f-6f9f-4105-8912-e94376cd1ce3 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:33.871179 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-afcce03f-6f9f-4105-8912-e94376cd1ce3 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:33.871934 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-afcce03f-6f9f-4105-8912-e94376cd1ce3 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:33.872364 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-afcce03f-6f9f-4105-8912-e94376cd1ce3 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:33.937719 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-afcce03f-6f9f-4105-8912-e94376cd1ce3 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:33.945814 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-afcce03f-6f9f-4105-8912-e94376cd1ce3 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1310 microversion: 2.1 time: 0.087646 May 26 12:42:33.946377 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 491/990] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:33 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1310 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:34.042560 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-1232b502-a132-4eb8-9915-841f846621c2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:34.043166 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-1232b502-a132-4eb8-9915-841f846621c2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:34.049870 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1232b502-a132-4eb8-9915-841f846621c2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:34.050320 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1232b502-a132-4eb8-9915-841f846621c2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:34.051080 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1232b502-a132-4eb8-9915-841f846621c2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:34.051516 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1232b502-a132-4eb8-9915-841f846621c2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:34.185388 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-1232b502-a132-4eb8-9915-841f846621c2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:34.194153 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-1232b502-a132-4eb8-9915-841f846621c2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:34.195659 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-1232b502-a132-4eb8-9915-841f846621c2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:34.196834 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-1232b502-a132-4eb8-9915-841f846621c2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1743 microversion: 2.20 time: 0.158201 May 26 12:42:34.197382 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 500/991] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:34 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:34.696640 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-4aa206f9-5b1a-4b4c-bcbf-3746764f6c0c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:34.697312 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-4aa206f9-5b1a-4b4c-bcbf-3746764f6c0c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:34.706016 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4aa206f9-5b1a-4b4c-bcbf-3746764f6c0c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:34.706646 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4aa206f9-5b1a-4b4c-bcbf-3746764f6c0c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:34.708566 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4aa206f9-5b1a-4b4c-bcbf-3746764f6c0c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:34.708566 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4aa206f9-5b1a-4b4c-bcbf-3746764f6c0c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:34.839729 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-4aa206f9-5b1a-4b4c-bcbf-3746764f6c0c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:34.848216 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-4aa206f9-5b1a-4b4c-bcbf-3746764f6c0c tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6" status: 200 len: 1367 microversion: 2.1 time: 0.156717 May 26 12:42:34.848806 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 492/992] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:34 2022] GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:34.963501 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-da51e6a2-bd48-47fc-a123-0d8bde6b3289 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:34.964131 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-da51e6a2-bd48-47fc-a123-0d8bde6b3289 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:34.972112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-da51e6a2-bd48-47fc-a123-0d8bde6b3289 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:34.972609 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-da51e6a2-bd48-47fc-a123-0d8bde6b3289 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:34.973462 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-da51e6a2-bd48-47fc-a123-0d8bde6b3289 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:34.973943 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-da51e6a2-bd48-47fc-a123-0d8bde6b3289 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:35.035927 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-da51e6a2-bd48-47fc-a123-0d8bde6b3289 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:35.043904 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-da51e6a2-bd48-47fc-a123-0d8bde6b3289 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1310 microversion: 2.1 time: 0.084398 May 26 12:42:35.044411 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 501/993] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:34 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:35.217365 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-7eeaac38-6c53-4b69-8486-3932994db645 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:35.218637 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-7eeaac38-6c53-4b69-8486-3932994db645 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:35.227496 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7eeaac38-6c53-4b69-8486-3932994db645 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:35.228214 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7eeaac38-6c53-4b69-8486-3932994db645 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:35.229257 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7eeaac38-6c53-4b69-8486-3932994db645 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:35.229870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7eeaac38-6c53-4b69-8486-3932994db645 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:35.402685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-7eeaac38-6c53-4b69-8486-3932994db645 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:35.411023 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-7eeaac38-6c53-4b69-8486-3932994db645 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:35.412523 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-7eeaac38-6c53-4b69-8486-3932994db645 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:35.413718 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-7eeaac38-6c53-4b69-8486-3932994db645 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1738 microversion: 2.20 time: 0.202044 May 26 12:42:35.414274 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 493/994] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:35 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:35.866259 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-cd36fef9-13e2-47d7-8ad0-dca9143c74df tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:35.867228 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-cd36fef9-13e2-47d7-8ad0-dca9143c74df tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:35.873353 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cd36fef9-13e2-47d7-8ad0-dca9143c74df tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:35.873812 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cd36fef9-13e2-47d7-8ad0-dca9143c74df tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:35.874626 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cd36fef9-13e2-47d7-8ad0-dca9143c74df tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:35.875071 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cd36fef9-13e2-47d7-8ad0-dca9143c74df tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:36.061722 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-9005ee36-4f93-4af9-8638-b69a9689c979 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:36.062475 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-9005ee36-4f93-4af9-8638-b69a9689c979 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:36.069466 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9005ee36-4f93-4af9-8638-b69a9689c979 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:36.071518 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9005ee36-4f93-4af9-8638-b69a9689c979 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:36.072822 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9005ee36-4f93-4af9-8638-b69a9689c979 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:36.073505 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9005ee36-4f93-4af9-8638-b69a9689c979 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:36.091566 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-cd36fef9-13e2-47d7-8ad0-dca9143c74df tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:36.104740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-cd36fef9-13e2-47d7-8ad0-dca9143c74df tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6" status: 200 len: 1367 microversion: 2.1 time: 0.242676 May 26 12:42:36.113433 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 502/995] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:35 2022] GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:36.158968 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-9005ee36-4f93-4af9-8638-b69a9689c979 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:36.166797 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-9005ee36-4f93-4af9-8638-b69a9689c979 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1316 microversion: 2.1 time: 0.108807 May 26 12:42:36.167376 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 494/996] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:36 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1316 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:36.440707 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-9d51de98-dc4d-4a42-a1a9-06fbfd87a51f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:36.442656 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-9d51de98-dc4d-4a42-a1a9-06fbfd87a51f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:36.453391 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9d51de98-dc4d-4a42-a1a9-06fbfd87a51f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:36.455034 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9d51de98-dc4d-4a42-a1a9-06fbfd87a51f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:36.456732 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9d51de98-dc4d-4a42-a1a9-06fbfd87a51f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:36.457729 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-9d51de98-dc4d-4a42-a1a9-06fbfd87a51f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:36.883945 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-9d51de98-dc4d-4a42-a1a9-06fbfd87a51f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:36.894339 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-9d51de98-dc4d-4a42-a1a9-06fbfd87a51f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:36.902725 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-9d51de98-dc4d-4a42-a1a9-06fbfd87a51f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:36.913325 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-9d51de98-dc4d-4a42-a1a9-06fbfd87a51f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1738 microversion: 2.20 time: 0.476786 May 26 12:42:36.914249 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 503/997] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:36 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1738 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:37.131793 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-30a816d5-7bdc-48f8-b129-8005c37e227d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:37.133421 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-30a816d5-7bdc-48f8-b129-8005c37e227d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:37.143793 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-30a816d5-7bdc-48f8-b129-8005c37e227d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:37.144768 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-30a816d5-7bdc-48f8-b129-8005c37e227d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:37.145824 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-30a816d5-7bdc-48f8-b129-8005c37e227d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:37.146700 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-30a816d5-7bdc-48f8-b129-8005c37e227d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:37.183479 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-2e4870cf-70dd-409c-9c20-9a404e6506b5 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:37.184143 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-2e4870cf-70dd-409c-9c20-9a404e6506b5 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:37.205165 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2e4870cf-70dd-409c-9c20-9a404e6506b5 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:37.208017 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2e4870cf-70dd-409c-9c20-9a404e6506b5 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:37.209116 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2e4870cf-70dd-409c-9c20-9a404e6506b5 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:37.209788 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2e4870cf-70dd-409c-9c20-9a404e6506b5 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:37.513959 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-2e4870cf-70dd-409c-9c20-9a404e6506b5 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:37.546669 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-2e4870cf-70dd-409c-9c20-9a404e6506b5 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1358 microversion: 2.1 time: 0.367039 May 26 12:42:37.551744 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 504/998] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:37 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1358 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:37.583346 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-30a816d5-7bdc-48f8-b129-8005c37e227d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:37.592006 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-30a816d5-7bdc-48f8-b129-8005c37e227d tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6" status: 200 len: 1557 microversion: 2.1 time: 0.466141 May 26 12:42:37.597611 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 495/999] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:37 2022] GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6 => generated 1557 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:37.624987 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f4936122-f1d9-4297-9411-9a7be6ba4c51 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:37.627959 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f4936122-f1d9-4297-9411-9a7be6ba4c51 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:37.642840 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f4936122-f1d9-4297-9411-9a7be6ba4c51 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:37.643622 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f4936122-f1d9-4297-9411-9a7be6ba4c51 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:37.644627 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f4936122-f1d9-4297-9411-9a7be6ba4c51 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:37.646072 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f4936122-f1d9-4297-9411-9a7be6ba4c51 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:37.818632 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f4936122-f1d9-4297-9411-9a7be6ba4c51 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.200970 May 26 12:42:37.824275 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 505/1000] 10.222.0.39 () {58 vars in 1274 bytes} [Thu May 26 12:42:37 2022] GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6/os-interface => generated 284 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:42:37.933479 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-05476941-4076-4abb-8738-4361f04971d3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:37.934472 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-05476941-4076-4abb-8738-4361f04971d3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:37.953188 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-05476941-4076-4abb-8738-4361f04971d3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:37.956801 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-05476941-4076-4abb-8738-4361f04971d3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:37.961365 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-05476941-4076-4abb-8738-4361f04971d3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:37.961832 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-05476941-4076-4abb-8738-4361f04971d3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:38.570695 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-328d778d-ea2b-4922-a74d-5e5db54db2df tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:38.571528 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-328d778d-ea2b-4922-a74d-5e5db54db2df tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:38.584610 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-05476941-4076-4abb-8738-4361f04971d3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:38.593339 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-328d778d-ea2b-4922-a74d-5e5db54db2df tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:38.593890 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-328d778d-ea2b-4922-a74d-5e5db54db2df tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:38.595654 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-328d778d-ea2b-4922-a74d-5e5db54db2df tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:38.596302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-328d778d-ea2b-4922-a74d-5e5db54db2df tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:38.597583 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-05476941-4076-4abb-8738-4361f04971d3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:38.604897 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-05476941-4076-4abb-8738-4361f04971d3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:38.606412 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-05476941-4076-4abb-8738-4361f04971d3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1738 microversion: 2.20 time: 0.678904 May 26 12:42:38.614239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 496/1001] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:37 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1738 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:39.348513 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-328d778d-ea2b-4922-a74d-5e5db54db2df tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:39.357983 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-328d778d-ea2b-4922-a74d-5e5db54db2df tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1358 microversion: 2.1 time: 0.794005 May 26 12:42:39.359341 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 506/1002] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:38 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1358 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:42:39.492695 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-80a7bfb7-1460-4363-aa46-74cb425ffaa5 req-b1c57c3d-c52c-411c-a987-5ea4bad0c628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a15a237-ed0e-403f-812e-805d26cd19b9", "tag": "3be3d457-3848-425b-9df9-3a6ed2996a1e"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:39.521634 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-80a7bfb7-1460-4363-aa46-74cb425ffaa5 req-b1c57c3d-c52c-411c-a987-5ea4bad0c628 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:39.522156 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-80a7bfb7-1460-4363-aa46-74cb425ffaa5 req-b1c57c3d-c52c-411c-a987-5ea4bad0c628 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:39.570614 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-80a7bfb7-1460-4363-aa46-74cb425ffaa5 req-b1c57c3d-c52c-411c-a987-5ea4bad0c628 service nova] Creating event network-changed:3be3d457-3848-425b-9df9-3a6ed2996a1e for instance 1a15a237-ed0e-403f-812e-805d26cd19b9 on hv-cinder-81514 May 26 12:42:39.587177 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-80a7bfb7-1460-4363-aa46-74cb425ffaa5 req-b1c57c3d-c52c-411c-a987-5ea4bad0c628 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098098 May 26 12:42:39.595290 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 497/1003] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:42:39.633660 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-a3620bd8-da87-46ab-b818-e1b6d3a4d6f2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:39.634310 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-a3620bd8-da87-46ab-b818-e1b6d3a4d6f2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:39.651341 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a3620bd8-da87-46ab-b818-e1b6d3a4d6f2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:39.651826 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a3620bd8-da87-46ab-b818-e1b6d3a4d6f2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:39.666917 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a3620bd8-da87-46ab-b818-e1b6d3a4d6f2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:39.667629 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a3620bd8-da87-46ab-b818-e1b6d3a4d6f2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:40.025810 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-a3620bd8-da87-46ab-b818-e1b6d3a4d6f2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:40.037431 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-a3620bd8-da87-46ab-b818-e1b6d3a4d6f2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:40.039333 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-a3620bd8-da87-46ab-b818-e1b6d3a4d6f2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:40.041080 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-a3620bd8-da87-46ab-b818-e1b6d3a4d6f2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1738 microversion: 2.20 time: 0.411963 May 26 12:42:40.053639 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 507/1004] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:39 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1738 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:40.379059 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-bbe3e5d1-e486-478e-84a0-953c29660abf tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:40.380143 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-bbe3e5d1-e486-478e-84a0-953c29660abf tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:40.390917 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bbe3e5d1-e486-478e-84a0-953c29660abf tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:40.391924 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bbe3e5d1-e486-478e-84a0-953c29660abf tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:40.392883 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bbe3e5d1-e486-478e-84a0-953c29660abf tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:40.393319 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bbe3e5d1-e486-478e-84a0-953c29660abf tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:40.697935 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-bbe3e5d1-e486-478e-84a0-953c29660abf tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:40.711154 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-bbe3e5d1-e486-478e-84a0-953c29660abf tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1358 microversion: 2.1 time: 0.335424 May 26 12:42:40.714485 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 498/1005] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:40 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1358 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:41.070683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-3b1028f0-338b-4b77-ac0f-7661cfe9143c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:41.072617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-3b1028f0-338b-4b77-ac0f-7661cfe9143c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:41.088297 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3b1028f0-338b-4b77-ac0f-7661cfe9143c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:41.089034 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3b1028f0-338b-4b77-ac0f-7661cfe9143c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:41.091430 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3b1028f0-338b-4b77-ac0f-7661cfe9143c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:41.092521 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3b1028f0-338b-4b77-ac0f-7661cfe9143c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:41.403084 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-3b1028f0-338b-4b77-ac0f-7661cfe9143c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:41.417608 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-3b1028f0-338b-4b77-ac0f-7661cfe9143c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:41.419707 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-3b1028f0-338b-4b77-ac0f-7661cfe9143c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:41.421171 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-3b1028f0-338b-4b77-ac0f-7661cfe9143c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1738 microversion: 2.20 time: 0.361191 May 26 12:42:41.425035 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 508/1006] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:41 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1738 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:41.700692 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-c4b0e6e5-0a37-4720-b1e5-8619dc07b5e0 req-077e37a1-48b6-4c0b-84df-6028e45499a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6569d326-c20a-4044-89b6-db08739f36f6", "tag": "a9732a91-5268-4fd5-8f72-233936555083"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:41.718018 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-c4b0e6e5-0a37-4720-b1e5-8619dc07b5e0 req-077e37a1-48b6-4c0b-84df-6028e45499a8 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:41.718693 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-c4b0e6e5-0a37-4720-b1e5-8619dc07b5e0 req-077e37a1-48b6-4c0b-84df-6028e45499a8 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:41.731543 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-2c1d2e2e-dbe1-489a-be1f-8696793b9bf0 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:41.732403 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-2c1d2e2e-dbe1-489a-be1f-8696793b9bf0 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:41.743688 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2c1d2e2e-dbe1-489a-be1f-8696793b9bf0 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:41.748146 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2c1d2e2e-dbe1-489a-be1f-8696793b9bf0 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:41.748696 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-c4b0e6e5-0a37-4720-b1e5-8619dc07b5e0 req-077e37a1-48b6-4c0b-84df-6028e45499a8 service nova] Creating event network-changed:a9732a91-5268-4fd5-8f72-233936555083 for instance 6569d326-c20a-4044-89b6-db08739f36f6 on hv-cinder-81514 May 26 12:42:41.749311 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2c1d2e2e-dbe1-489a-be1f-8696793b9bf0 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:41.749864 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2c1d2e2e-dbe1-489a-be1f-8696793b9bf0 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:41.762569 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-c4b0e6e5-0a37-4720-b1e5-8619dc07b5e0 req-077e37a1-48b6-4c0b-84df-6028e45499a8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065851 May 26 12:42:41.763490 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 499/1007] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:42:42.081183 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-2c1d2e2e-dbe1-489a-be1f-8696793b9bf0 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:42.091245 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-2c1d2e2e-dbe1-489a-be1f-8696793b9bf0 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1358 microversion: 2.1 time: 0.363456 May 26 12:42:42.092271 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 509/1008] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:41 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1358 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:42.449829 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-7fd21258-f035-44fe-8ad7-07325150b0d1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:42.450951 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-7fd21258-f035-44fe-8ad7-07325150b0d1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:42.459701 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7fd21258-f035-44fe-8ad7-07325150b0d1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:42.460535 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7fd21258-f035-44fe-8ad7-07325150b0d1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:42.461756 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7fd21258-f035-44fe-8ad7-07325150b0d1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:42.462490 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7fd21258-f035-44fe-8ad7-07325150b0d1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:42.757812 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-7fd21258-f035-44fe-8ad7-07325150b0d1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:42.770613 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-7fd21258-f035-44fe-8ad7-07325150b0d1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:42.773428 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-7fd21258-f035-44fe-8ad7-07325150b0d1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:42.774840 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-7fd21258-f035-44fe-8ad7-07325150b0d1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1738 microversion: 2.20 time: 0.329939 May 26 12:42:42.788686 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 500/1009] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:42 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1738 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:43.111907 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-80af745e-9667-4ea3-9255-40e7e1687310 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:43.116353 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-80af745e-9667-4ea3-9255-40e7e1687310 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:43.118611 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=2 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:43.121746 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=6 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:43.131481 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-80af745e-9667-4ea3-9255-40e7e1687310 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:43.132320 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-80af745e-9667-4ea3-9255-40e7e1687310 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:43.133373 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-80af745e-9667-4ea3-9255-40e7e1687310 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:43.134041 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-80af745e-9667-4ea3-9255-40e7e1687310 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:43.347628 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-80af745e-9667-4ea3-9255-40e7e1687310 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:43.362240 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-80af745e-9667-4ea3-9255-40e7e1687310 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1358 microversion: 2.1 time: 0.254931 May 26 12:42:43.364489 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 510/1010] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:43 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:43.792479 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell0:SELECT=6 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:43.798180 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b1b8f712-fb2e-4f08-aee8-2e833ef5eca1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:43.799227 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b1b8f712-fb2e-4f08-aee8-2e833ef5eca1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:43.804916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:43.807159 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b1b8f712-fb2e-4f08-aee8-2e833ef5eca1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:43.807831 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b1b8f712-fb2e-4f08-aee8-2e833ef5eca1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:43.809384 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b1b8f712-fb2e-4f08-aee8-2e833ef5eca1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:43.810071 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b1b8f712-fb2e-4f08-aee8-2e833ef5eca1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:44.015410 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b1b8f712-fb2e-4f08-aee8-2e833ef5eca1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:44.035315 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b1b8f712-fb2e-4f08-aee8-2e833ef5eca1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:44.036940 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b1b8f712-fb2e-4f08-aee8-2e833ef5eca1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:44.038154 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b1b8f712-fb2e-4f08-aee8-2e833ef5eca1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1738 microversion: 2.20 time: 0.246545 May 26 12:42:44.038717 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 501/1011] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:43 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1738 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:44.389784 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d4ea310a-b659-422f-a698-816de2c17fc9 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:44.389784 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d4ea310a-b659-422f-a698-816de2c17fc9 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:44.398206 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:44.400857 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d4ea310a-b659-422f-a698-816de2c17fc9 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:44.401901 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d4ea310a-b659-422f-a698-816de2c17fc9 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:44.403037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d4ea310a-b659-422f-a698-816de2c17fc9 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:44.403519 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d4ea310a-b659-422f-a698-816de2c17fc9 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:44.576914 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d4ea310a-b659-422f-a698-816de2c17fc9 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:44.586269 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-d4ea310a-b659-422f-a698-816de2c17fc9 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1358 microversion: 2.1 time: 0.208499 May 26 12:42:44.586867 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 511/1012] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:44 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:45.060035 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-a243784f-03d0-496a-add7-70f4142c853e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:45.061468 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-a243784f-03d0-496a-add7-70f4142c853e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:45.068790 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a243784f-03d0-496a-add7-70f4142c853e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:45.069568 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a243784f-03d0-496a-add7-70f4142c853e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:45.070355 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a243784f-03d0-496a-add7-70f4142c853e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:45.070795 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a243784f-03d0-496a-add7-70f4142c853e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:45.075461 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=100 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:45.221335 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a243784f-03d0-496a-add7-70f4142c853e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:45.230567 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a243784f-03d0-496a-add7-70f4142c853e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:45.232624 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a243784f-03d0-496a-add7-70f4142c853e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:45.233912 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-a243784f-03d0-496a-add7-70f4142c853e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1738 microversion: 2.20 time: 0.178966 May 26 12:42:45.234557 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 502/1013] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:45 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:45.603776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-8e517072-3ed6-4736-8910-fe80545e810c tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:45.604703 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-8e517072-3ed6-4736-8910-fe80545e810c tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:45.613038 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8e517072-3ed6-4736-8910-fe80545e810c tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:45.613386 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8e517072-3ed6-4736-8910-fe80545e810c tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:45.614270 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8e517072-3ed6-4736-8910-fe80545e810c tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:45.614814 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8e517072-3ed6-4736-8910-fe80545e810c tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:45.762438 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-8e517072-3ed6-4736-8910-fe80545e810c tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:45.771102 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-8e517072-3ed6-4736-8910-fe80545e810c tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1358 microversion: 2.1 time: 0.171172 May 26 12:42:45.771968 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 512/1014] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:45 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:46.561814 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-ccdc5a8b-ea7e-4790-9fd3-59884e04e33c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:46.564109 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-ccdc5a8b-ea7e-4790-9fd3-59884e04e33c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:46.572352 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ccdc5a8b-ea7e-4790-9fd3-59884e04e33c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:46.573467 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ccdc5a8b-ea7e-4790-9fd3-59884e04e33c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:46.574502 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ccdc5a8b-ea7e-4790-9fd3-59884e04e33c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:46.575365 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ccdc5a8b-ea7e-4790-9fd3-59884e04e33c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:46.763708 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ccdc5a8b-ea7e-4790-9fd3-59884e04e33c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:46.789177 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-8f3b9494-b746-44cc-a463-f6dae270644a tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:46.790552 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-8f3b9494-b746-44cc-a463-f6dae270644a tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:46.800958 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8f3b9494-b746-44cc-a463-f6dae270644a tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:46.802007 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ccdc5a8b-ea7e-4790-9fd3-59884e04e33c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:46.803744 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8f3b9494-b746-44cc-a463-f6dae270644a tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:46.804786 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ccdc5a8b-ea7e-4790-9fd3-59884e04e33c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:46.806394 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8f3b9494-b746-44cc-a463-f6dae270644a tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:46.807837 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-ccdc5a8b-ea7e-4790-9fd3-59884e04e33c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1738 microversion: 2.20 time: 0.558941 May 26 12:42:46.808680 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8f3b9494-b746-44cc-a463-f6dae270644a tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:46.812971 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 503/1015] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:46 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1738 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:42:47.027208 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-8f3b9494-b746-44cc-a463-f6dae270644a tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:47.040956 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-8f3b9494-b746-44cc-a463-f6dae270644a tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1358 microversion: 2.1 time: 0.256350 May 26 12:42:47.043659 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 513/1016] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:46 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1358 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:47.840284 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-2430fe15-8c48-45d2-b991-9d7f63184a68 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:47.840928 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-2430fe15-8c48-45d2-b991-9d7f63184a68 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:47.859940 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2430fe15-8c48-45d2-b991-9d7f63184a68 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:47.861201 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2430fe15-8c48-45d2-b991-9d7f63184a68 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:47.866144 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2430fe15-8c48-45d2-b991-9d7f63184a68 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:47.866801 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2430fe15-8c48-45d2-b991-9d7f63184a68 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:48.021532 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2430fe15-8c48-45d2-b991-9d7f63184a68 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:48.029897 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2430fe15-8c48-45d2-b991-9d7f63184a68 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:48.031511 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2430fe15-8c48-45d2-b991-9d7f63184a68 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:48.033732 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-2430fe15-8c48-45d2-b991-9d7f63184a68 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1738 microversion: 2.20 time: 0.205903 May 26 12:42:48.036756 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 504/1017] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:47 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:48.061922 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-52e93f07-8d47-4b72-8eff-b196d59621ff tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:48.063884 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-52e93f07-8d47-4b72-8eff-b196d59621ff tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:48.074094 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-52e93f07-8d47-4b72-8eff-b196d59621ff tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:48.074645 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-52e93f07-8d47-4b72-8eff-b196d59621ff tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:48.075518 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-52e93f07-8d47-4b72-8eff-b196d59621ff tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:48.076035 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-52e93f07-8d47-4b72-8eff-b196d59621ff tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:48.220945 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-52e93f07-8d47-4b72-8eff-b196d59621ff tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:48.230552 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-52e93f07-8d47-4b72-8eff-b196d59621ff tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1358 microversion: 2.1 time: 0.174113 May 26 12:42:48.236392 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 514/1018] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:48 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:49.056197 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-af906878-991f-49ae-8336-1f7daf887589 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:49.056939 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-af906878-991f-49ae-8336-1f7daf887589 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:49.065468 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-af906878-991f-49ae-8336-1f7daf887589 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:49.065947 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-af906878-991f-49ae-8336-1f7daf887589 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:49.067400 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-af906878-991f-49ae-8336-1f7daf887589 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:49.068449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-af906878-991f-49ae-8336-1f7daf887589 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:49.210661 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-af906878-991f-49ae-8336-1f7daf887589 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:49.219087 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-af906878-991f-49ae-8336-1f7daf887589 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:49.220934 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-af906878-991f-49ae-8336-1f7daf887589 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:49.222839 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-af906878-991f-49ae-8336-1f7daf887589 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1738 microversion: 2.20 time: 0.170625 May 26 12:42:49.223567 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 505/1019] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:49 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:49.248135 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f0ec0126-a422-42a7-857a-06f4ea76821d tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:49.249428 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f0ec0126-a422-42a7-857a-06f4ea76821d tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:49.259118 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f0ec0126-a422-42a7-857a-06f4ea76821d tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:49.259964 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f0ec0126-a422-42a7-857a-06f4ea76821d tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:49.261090 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f0ec0126-a422-42a7-857a-06f4ea76821d tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:49.261762 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f0ec0126-a422-42a7-857a-06f4ea76821d tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:49.408501 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f0ec0126-a422-42a7-857a-06f4ea76821d tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:49.412038 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=100 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:49.417258 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f0ec0126-a422-42a7-857a-06f4ea76821d tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1358 microversion: 2.1 time: 0.172942 May 26 12:42:49.417799 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 515/1020] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:49 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:50.241617 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6eee2bfd-078a-4770-b979-bc72219f0c1d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:50.242223 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-6eee2bfd-078a-4770-b979-bc72219f0c1d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:50.248676 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6eee2bfd-078a-4770-b979-bc72219f0c1d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:50.249151 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6eee2bfd-078a-4770-b979-bc72219f0c1d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:50.249902 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6eee2bfd-078a-4770-b979-bc72219f0c1d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:50.250867 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6eee2bfd-078a-4770-b979-bc72219f0c1d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:50.377881 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-6eee2bfd-078a-4770-b979-bc72219f0c1d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:50.388339 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-6eee2bfd-078a-4770-b979-bc72219f0c1d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:50.389876 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-6eee2bfd-078a-4770-b979-bc72219f0c1d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:50.392163 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-6eee2bfd-078a-4770-b979-bc72219f0c1d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1738 microversion: 2.20 time: 0.153445 May 26 12:42:50.393227 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 506/1021] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:50 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:50.434385 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-fdf3a067-aaf0-40d4-96ec-e4507da13d53 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:50.435002 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-fdf3a067-aaf0-40d4-96ec-e4507da13d53 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:50.442384 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fdf3a067-aaf0-40d4-96ec-e4507da13d53 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:50.442841 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fdf3a067-aaf0-40d4-96ec-e4507da13d53 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:50.443608 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fdf3a067-aaf0-40d4-96ec-e4507da13d53 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:50.444084 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fdf3a067-aaf0-40d4-96ec-e4507da13d53 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:50.574998 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-fdf3a067-aaf0-40d4-96ec-e4507da13d53 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:50.583116 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-fdf3a067-aaf0-40d4-96ec-e4507da13d53 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1358 microversion: 2.1 time: 0.152481 May 26 12:42:50.583699 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 516/1022] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:50 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:51.412182 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-d2151420-0ee0-4d5a-969c-3f91776ee5d2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:51.412812 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-d2151420-0ee0-4d5a-969c-3f91776ee5d2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:51.419208 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d2151420-0ee0-4d5a-969c-3f91776ee5d2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:51.419656 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d2151420-0ee0-4d5a-969c-3f91776ee5d2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:51.420408 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d2151420-0ee0-4d5a-969c-3f91776ee5d2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:51.420870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d2151420-0ee0-4d5a-969c-3f91776ee5d2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:51.564248 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d2151420-0ee0-4d5a-969c-3f91776ee5d2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:51.572858 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d2151420-0ee0-4d5a-969c-3f91776ee5d2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:51.574373 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d2151420-0ee0-4d5a-969c-3f91776ee5d2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:51.575552 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-d2151420-0ee0-4d5a-969c-3f91776ee5d2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1738 microversion: 2.20 time: 0.167380 May 26 12:42:51.576117 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 507/1023] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:51 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:51.599701 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-bff49b3b-dcbf-45df-921d-7503033d7398 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:51.600319 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-bff49b3b-dcbf-45df-921d-7503033d7398 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:51.606867 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bff49b3b-dcbf-45df-921d-7503033d7398 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:51.607325 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bff49b3b-dcbf-45df-921d-7503033d7398 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:51.608101 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bff49b3b-dcbf-45df-921d-7503033d7398 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:51.608542 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bff49b3b-dcbf-45df-921d-7503033d7398 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:51.743120 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-bff49b3b-dcbf-45df-921d-7503033d7398 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:51.750796 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-bff49b3b-dcbf-45df-921d-7503033d7398 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1358 microversion: 2.1 time: 0.154994 May 26 12:42:51.751363 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 517/1024] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:51 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:52.594984 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6ea8f34e-b721-4fed-b191-f1c301add8db tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:52.595587 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-6ea8f34e-b721-4fed-b191-f1c301add8db tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:52.602686 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6ea8f34e-b721-4fed-b191-f1c301add8db tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:52.603129 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6ea8f34e-b721-4fed-b191-f1c301add8db tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:52.603899 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6ea8f34e-b721-4fed-b191-f1c301add8db tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:52.604318 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6ea8f34e-b721-4fed-b191-f1c301add8db tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:52.736453 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-6ea8f34e-b721-4fed-b191-f1c301add8db tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:52.744366 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-6ea8f34e-b721-4fed-b191-f1c301add8db tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:52.745924 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-6ea8f34e-b721-4fed-b191-f1c301add8db tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:52.747076 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-6ea8f34e-b721-4fed-b191-f1c301add8db tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1738 microversion: 2.20 time: 0.156072 May 26 12:42:52.747609 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 508/1025] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:52 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:52.773846 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f216ad66-22be-4493-9f69-ef8774ae8b10 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:52.774392 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f216ad66-22be-4493-9f69-ef8774ae8b10 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:52.780809 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f216ad66-22be-4493-9f69-ef8774ae8b10 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:52.781258 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f216ad66-22be-4493-9f69-ef8774ae8b10 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:52.783022 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f216ad66-22be-4493-9f69-ef8774ae8b10 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:52.783674 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f216ad66-22be-4493-9f69-ef8774ae8b10 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:52.913402 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f216ad66-22be-4493-9f69-ef8774ae8b10 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:52.921106 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f216ad66-22be-4493-9f69-ef8774ae8b10 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1358 microversion: 2.1 time: 0.151141 May 26 12:42:52.921700 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 518/1026] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:52 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:53.764549 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-694ab257-d57c-40a9-8e9b-faaa275f6750 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:53.765180 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-694ab257-d57c-40a9-8e9b-faaa275f6750 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:53.774207 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-694ab257-d57c-40a9-8e9b-faaa275f6750 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:53.774660 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-694ab257-d57c-40a9-8e9b-faaa275f6750 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:53.775530 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-694ab257-d57c-40a9-8e9b-faaa275f6750 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:53.775973 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-694ab257-d57c-40a9-8e9b-faaa275f6750 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:53.908477 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-694ab257-d57c-40a9-8e9b-faaa275f6750 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:53.916396 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-694ab257-d57c-40a9-8e9b-faaa275f6750 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:53.917933 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-694ab257-d57c-40a9-8e9b-faaa275f6750 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:53.919076 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-694ab257-d57c-40a9-8e9b-faaa275f6750 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1738 microversion: 2.20 time: 0.158487 May 26 12:42:53.919637 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 509/1027] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:53 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:53.937867 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-dc3a60c3-bbdd-4fcf-8225-700313ad7706 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:53.938614 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-dc3a60c3-bbdd-4fcf-8225-700313ad7706 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:53.945241 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dc3a60c3-bbdd-4fcf-8225-700313ad7706 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:53.945687 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dc3a60c3-bbdd-4fcf-8225-700313ad7706 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:53.946442 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dc3a60c3-bbdd-4fcf-8225-700313ad7706 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:53.946880 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dc3a60c3-bbdd-4fcf-8225-700313ad7706 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:54.076777 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-dc3a60c3-bbdd-4fcf-8225-700313ad7706 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:54.084227 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-dc3a60c3-bbdd-4fcf-8225-700313ad7706 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1358 microversion: 2.1 time: 0.150258 May 26 12:42:54.084813 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 519/1028] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:53 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:54.937961 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-437679a4-1ea1-4a68-b080-771ec39390c0 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:54.938689 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-437679a4-1ea1-4a68-b080-771ec39390c0 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:54.946176 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-437679a4-1ea1-4a68-b080-771ec39390c0 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:54.946176 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-437679a4-1ea1-4a68-b080-771ec39390c0 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:54.946885 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-437679a4-1ea1-4a68-b080-771ec39390c0 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:54.947326 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-437679a4-1ea1-4a68-b080-771ec39390c0 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:55.085209 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-437679a4-1ea1-4a68-b080-771ec39390c0 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:55.093534 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-437679a4-1ea1-4a68-b080-771ec39390c0 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:55.095330 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-437679a4-1ea1-4a68-b080-771ec39390c0 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:55.098457 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-437679a4-1ea1-4a68-b080-771ec39390c0 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1720 microversion: 2.20 time: 0.163940 May 26 12:42:55.101233 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-339224e0-b58b-48fb-a236-295106ef4b40 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:55.102383 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-339224e0-b58b-48fb-a236-295106ef4b40 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:55.109130 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-339224e0-b58b-48fb-a236-295106ef4b40 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:55.109617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-339224e0-b58b-48fb-a236-295106ef4b40 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:55.111109 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 510/1029] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:54 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:55.111396 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-339224e0-b58b-48fb-a236-295106ef4b40 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:55.111849 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-339224e0-b58b-48fb-a236-295106ef4b40 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:55.153579 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-0d2997b5-f3e2-4d7d-b7c1-435cbb0acc21 req-0e07c898-4ec5-4f51-abde-d11b4674114b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2", "name": "network-vif-unplugged", "status": "completed", "tag": "c3caaa3d-4347-42cd-a614-454eabf81b41"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:55.163770 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-0d2997b5-f3e2-4d7d-b7c1-435cbb0acc21 req-0e07c898-4ec5-4f51-abde-d11b4674114b service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:55.164357 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-0d2997b5-f3e2-4d7d-b7c1-435cbb0acc21 req-0e07c898-4ec5-4f51-abde-d11b4674114b service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:55.177242 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-0d2997b5-f3e2-4d7d-b7c1-435cbb0acc21 req-0e07c898-4ec5-4f51-abde-d11b4674114b service nova] Creating event network-vif-unplugged:c3caaa3d-4347-42cd-a614-454eabf81b41 for instance f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 on hv-cinder-81514 May 26 12:42:55.183418 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-0d2997b5-f3e2-4d7d-b7c1-435cbb0acc21 req-0e07c898-4ec5-4f51-abde-d11b4674114b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036174 May 26 12:42:55.184840 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 511/1030] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:42:55.260417 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-339224e0-b58b-48fb-a236-295106ef4b40 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:55.269122 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-339224e0-b58b-48fb-a236-295106ef4b40 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1358 microversion: 2.1 time: 0.172022 May 26 12:42:55.269900 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 520/1031] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:55 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:56.118293 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-70c3b012-fd8f-4d49-9a78-dbaddbca110b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:56.118902 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-70c3b012-fd8f-4d49-9a78-dbaddbca110b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:56.125018 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-70c3b012-fd8f-4d49-9a78-dbaddbca110b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:56.126017 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-70c3b012-fd8f-4d49-9a78-dbaddbca110b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:56.127055 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-70c3b012-fd8f-4d49-9a78-dbaddbca110b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:56.127490 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-70c3b012-fd8f-4d49-9a78-dbaddbca110b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:56.264545 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-70c3b012-fd8f-4d49-9a78-dbaddbca110b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:56.273495 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-70c3b012-fd8f-4d49-9a78-dbaddbca110b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:56.275008 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-70c3b012-fd8f-4d49-9a78-dbaddbca110b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:56.276161 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-70c3b012-fd8f-4d49-9a78-dbaddbca110b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1720 microversion: 2.20 time: 0.162697 May 26 12:42:56.276737 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 512/1032] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:56 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:56.286134 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e071a107-a8a8-4c8f-add2-a7e1b7853567 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:56.286872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e071a107-a8a8-4c8f-add2-a7e1b7853567 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:56.293474 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e071a107-a8a8-4c8f-add2-a7e1b7853567 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:56.294000 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e071a107-a8a8-4c8f-add2-a7e1b7853567 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:56.294834 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e071a107-a8a8-4c8f-add2-a7e1b7853567 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:56.295364 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e071a107-a8a8-4c8f-add2-a7e1b7853567 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:56.427458 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e071a107-a8a8-4c8f-add2-a7e1b7853567 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:56.435095 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e071a107-a8a8-4c8f-add2-a7e1b7853567 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1358 microversion: 2.1 time: 0.152775 May 26 12:42:56.435656 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 521/1033] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:56 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:57.210923 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-3d2ceea4-4be2-4626-9d5d-a559b71d0850 req-5cedab27-0ab8-490d-b044-3917d5a7e573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a15a237-ed0e-403f-812e-805d26cd19b9", "name": "network-vif-plugged", "status": "completed", "tag": "3be3d457-3848-425b-9df9-3a6ed2996a1e"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:57.226237 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-3d2ceea4-4be2-4626-9d5d-a559b71d0850 req-5cedab27-0ab8-490d-b044-3917d5a7e573 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:57.226686 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-3d2ceea4-4be2-4626-9d5d-a559b71d0850 req-5cedab27-0ab8-490d-b044-3917d5a7e573 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:57.239198 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-3d2ceea4-4be2-4626-9d5d-a559b71d0850 req-5cedab27-0ab8-490d-b044-3917d5a7e573 service nova] Creating event network-vif-plugged:3be3d457-3848-425b-9df9-3a6ed2996a1e for instance 1a15a237-ed0e-403f-812e-805d26cd19b9 on hv-cinder-81514 May 26 12:42:57.244964 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-3d2ceea4-4be2-4626-9d5d-a559b71d0850 req-5cedab27-0ab8-490d-b044-3917d5a7e573 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037724 May 26 12:42:57.245580 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 513/1034] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:42:57.294796 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ebf359c5-c196-4b41-9fba-634b38b510f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:57.295414 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ebf359c5-c196-4b41-9fba-634b38b510f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:57.301949 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ebf359c5-c196-4b41-9fba-634b38b510f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:57.302405 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ebf359c5-c196-4b41-9fba-634b38b510f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:57.303170 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ebf359c5-c196-4b41-9fba-634b38b510f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:57.303615 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ebf359c5-c196-4b41-9fba-634b38b510f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:57.453118 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-93f0bd47-2dae-4808-945d-0fb13b761aca tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:57.454144 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-93f0bd47-2dae-4808-945d-0fb13b761aca tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:57.461153 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-93f0bd47-2dae-4808-945d-0fb13b761aca tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:57.461612 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-93f0bd47-2dae-4808-945d-0fb13b761aca tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:57.462391 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-93f0bd47-2dae-4808-945d-0fb13b761aca tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:57.462834 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-93f0bd47-2dae-4808-945d-0fb13b761aca tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:57.771937 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ebf359c5-c196-4b41-9fba-634b38b510f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:57.776000 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-93f0bd47-2dae-4808-945d-0fb13b761aca tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:57.779970 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ebf359c5-c196-4b41-9fba-634b38b510f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:57.782049 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ebf359c5-c196-4b41-9fba-634b38b510f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:57.783406 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ebf359c5-c196-4b41-9fba-634b38b510f5 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1723 microversion: 2.20 time: 0.492543 May 26 12:42:57.783835 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-93f0bd47-2dae-4808-945d-0fb13b761aca tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1358 microversion: 2.1 time: 0.335053 May 26 12:42:57.783966 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 522/1035] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:57 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1723 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:42:57.784506 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 514/1036] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:57 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1358 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:57.803740 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d587f180-08df-4acd-a09a-4492438cfea9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5012fd13-64fd-48c9-97c2-e0f335dcee6c"}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:57.804912 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d587f180-08df-4acd-a09a-4492438cfea9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:57.810977 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d587f180-08df-4acd-a09a-4492438cfea9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:57.811436 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d587f180-08df-4acd-a09a-4492438cfea9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:57.812205 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d587f180-08df-4acd-a09a-4492438cfea9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:57.812987 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d587f180-08df-4acd-a09a-4492438cfea9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:58.077859 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-d587f180-08df-4acd-a09a-4492438cfea9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "POST /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.281135 May 26 12:42:58.078948 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 523/1037] 10.222.0.39 () {62 vars in 1363 bytes} [Thu May 26 12:42:57 2022] POST /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2/os-volume_attachments => generated 188 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:42:58.192899 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-62ccc8a9-a4f0-4647-9026-ab0493991731 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:58.193498 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-62ccc8a9-a4f0-4647-9026-ab0493991731 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:58.199889 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-62ccc8a9-a4f0-4647-9026-ab0493991731 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:58.200349 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-62ccc8a9-a4f0-4647-9026-ab0493991731 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:58.201148 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-62ccc8a9-a4f0-4647-9026-ab0493991731 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:58.201597 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-62ccc8a9-a4f0-4647-9026-ab0493991731 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:58.450546 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-62ccc8a9-a4f0-4647-9026-ab0493991731 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2/os-volume_attachments/5012fd13-64fd-48c9-97c2-e0f335dcee6c" status: 202 len: 0 microversion: 2.20 time: 0.261741 May 26 12:42:58.451221 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 515/1038] 10.222.0.39 () {60 vars in 1456 bytes} [Thu May 26 12:42:58 2022] DELETE /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2/os-volume_attachments/5012fd13-64fd-48c9-97c2-e0f335dcee6c => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 12:42:58.513895 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-40671a0e-7091-416d-8b0c-5aa2c08183c2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:42:58.514474 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-40671a0e-7091-416d-8b0c-5aa2c08183c2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:58.521485 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-40671a0e-7091-416d-8b0c-5aa2c08183c2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:58.521949 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-40671a0e-7091-416d-8b0c-5aa2c08183c2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:58.523011 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-40671a0e-7091-416d-8b0c-5aa2c08183c2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:58.523271 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-40671a0e-7091-416d-8b0c-5aa2c08183c2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:58.613862 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-40671a0e-7091-416d-8b0c-5aa2c08183c2 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "POST /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2/action" status: 202 len: 0 microversion: 2.20 time: 0.103924 May 26 12:42:58.614482 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 524/1039] 10.222.0.39 () {62 vars in 1318 bytes} [Thu May 26 12:42:58 2022] POST /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 12:42:58.622728 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e6e9da04-a8eb-4b13-a07b-b55d30f6368e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:58.623467 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-e6e9da04-a8eb-4b13-a07b-b55d30f6368e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:58.632586 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e6e9da04-a8eb-4b13-a07b-b55d30f6368e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:58.633150 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e6e9da04-a8eb-4b13-a07b-b55d30f6368e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:58.634030 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e6e9da04-a8eb-4b13-a07b-b55d30f6368e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:58.634572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e6e9da04-a8eb-4b13-a07b-b55d30f6368e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:58.777336 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-e6e9da04-a8eb-4b13-a07b-b55d30f6368e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:58.786424 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-e6e9da04-a8eb-4b13-a07b-b55d30f6368e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:58.788433 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-e6e9da04-a8eb-4b13-a07b-b55d30f6368e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:58.789620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-e6e9da04-a8eb-4b13-a07b-b55d30f6368e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1671 microversion: 2.20 time: 0.170931 May 26 12:42:58.790223 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 516/1040] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:58 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1671 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:42:58.801413 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ff54730c-cf13-430c-bbab-1acd1cd3467b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:58.801870 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ff54730c-cf13-430c-bbab-1acd1cd3467b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:58.808076 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ff54730c-cf13-430c-bbab-1acd1cd3467b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:58.808535 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ff54730c-cf13-430c-bbab-1acd1cd3467b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:58.809558 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ff54730c-cf13-430c-bbab-1acd1cd3467b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:58.810010 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ff54730c-cf13-430c-bbab-1acd1cd3467b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:58.995160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ff54730c-cf13-430c-bbab-1acd1cd3467b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:59.002846 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ff54730c-cf13-430c-bbab-1acd1cd3467b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1358 microversion: 2.1 time: 0.205828 May 26 12:42:59.003420 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 525/1041] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:42:58 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:42:59.809070 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-2021a550-fef2-413b-9def-5bb2c2a28f08 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:42:59.809620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-2021a550-fef2-413b-9def-5bb2c2a28f08 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:42:59.817434 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2021a550-fef2-413b-9def-5bb2c2a28f08 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:59.817947 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2021a550-fef2-413b-9def-5bb2c2a28f08 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:59.818814 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2021a550-fef2-413b-9def-5bb2c2a28f08 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:42:59.819294 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2021a550-fef2-413b-9def-5bb2c2a28f08 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:42:59.956504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2021a550-fef2-413b-9def-5bb2c2a28f08 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:59.958948 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:59.966255 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2021a550-fef2-413b-9def-5bb2c2a28f08 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:59.967741 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2021a550-fef2-413b-9def-5bb2c2a28f08 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:42:59.968958 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-2021a550-fef2-413b-9def-5bb2c2a28f08 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1673 microversion: 2.20 time: 0.163968 May 26 12:42:59.969730 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 517/1042] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:42:59 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:00.020665 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f9e770a1-1560-4b07-8ec6-53aae7b79275 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:00.021375 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f9e770a1-1560-4b07-8ec6-53aae7b79275 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:00.027736 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f9e770a1-1560-4b07-8ec6-53aae7b79275 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:00.028184 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f9e770a1-1560-4b07-8ec6-53aae7b79275 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:00.028993 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f9e770a1-1560-4b07-8ec6-53aae7b79275 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:00.029431 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f9e770a1-1560-4b07-8ec6-53aae7b79275 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:00.157853 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f9e770a1-1560-4b07-8ec6-53aae7b79275 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:00.165274 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f9e770a1-1560-4b07-8ec6-53aae7b79275 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1549 microversion: 2.1 time: 0.149523 May 26 12:43:00.165841 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 526/1043] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:43:00 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:00.181624 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-79d98b9f-2f76-433d-a3c9-506e285f9cb6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:00.182242 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-79d98b9f-2f76-433d-a3c9-506e285f9cb6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:00.189605 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-79d98b9f-2f76-433d-a3c9-506e285f9cb6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:00.190106 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-79d98b9f-2f76-433d-a3c9-506e285f9cb6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:00.190908 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-79d98b9f-2f76-433d-a3c9-506e285f9cb6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:00.191355 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-79d98b9f-2f76-433d-a3c9-506e285f9cb6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:00.325614 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-79d98b9f-2f76-433d-a3c9-506e285f9cb6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:00.334151 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-79d98b9f-2f76-433d-a3c9-506e285f9cb6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1549 microversion: 2.1 time: 0.156311 May 26 12:43:00.334934 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 518/1044] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:43:00 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:00.350504 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-69008f4e-7775-408e-9746-cd2cb29c26b7 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:00.353887 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-69008f4e-7775-408e-9746-cd2cb29c26b7 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:00.354653 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-69008f4e-7775-408e-9746-cd2cb29c26b7 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Searching by: {'deleted': False, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e'} {{(pid=124133) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 26 12:43:00.361680 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-69008f4e-7775-408e-9746-cd2cb29c26b7 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:00.362132 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-69008f4e-7775-408e-9746-cd2cb29c26b7 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:00.362933 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-69008f4e-7775-408e-9746-cd2cb29c26b7 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:00.363397 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-69008f4e-7775-408e-9746-cd2cb29c26b7 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:00.453267 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.multi_cell_list [None req-69008f4e-7775-408e-9746-cd2cb29c26b7 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 26 12:43:00.554116 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-69008f4e-7775-408e-9746-cd2cb29c26b7 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.207361 May 26 12:43:00.554737 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 527/1045] 10.222.0.39 () {58 vars in 1124 bytes} [Thu May 26 12:43:00 2022] GET /compute/v2.1/servers => generated 342 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:43:00.565325 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-7bd07b24-dc27-4cc8-9ff0-5e70ed2fb587 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:00.566043 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-7bd07b24-dc27-4cc8-9ff0-5e70ed2fb587 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:00.572186 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7bd07b24-dc27-4cc8-9ff0-5e70ed2fb587 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:00.572744 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7bd07b24-dc27-4cc8-9ff0-5e70ed2fb587 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:00.573568 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7bd07b24-dc27-4cc8-9ff0-5e70ed2fb587 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:00.574099 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7bd07b24-dc27-4cc8-9ff0-5e70ed2fb587 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:00.704363 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-7bd07b24-dc27-4cc8-9ff0-5e70ed2fb587 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:00.712731 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-7bd07b24-dc27-4cc8-9ff0-5e70ed2fb587 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1549 microversion: 2.1 time: 0.151715 May 26 12:43:00.713309 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 519/1046] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:43:00 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:00.990060 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-760b941d-0888-428f-8e11-34bccf90d29e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:00.990646 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-760b941d-0888-428f-8e11-34bccf90d29e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:00.997295 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-760b941d-0888-428f-8e11-34bccf90d29e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:00.997790 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-760b941d-0888-428f-8e11-34bccf90d29e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:00.998772 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-760b941d-0888-428f-8e11-34bccf90d29e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:00.999215 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-760b941d-0888-428f-8e11-34bccf90d29e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:01.023718 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:01.153058 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-760b941d-0888-428f-8e11-34bccf90d29e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:01.161802 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-760b941d-0888-428f-8e11-34bccf90d29e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:01.163217 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-760b941d-0888-428f-8e11-34bccf90d29e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:01.164364 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-760b941d-0888-428f-8e11-34bccf90d29e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1729 microversion: 2.20 time: 0.179457 May 26 12:43:01.164953 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 528/1047] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:43:00 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:02.192637 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-c9bfef19-66d7-47c5-8f21-68a8d26d92c1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:02.193431 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-c9bfef19-66d7-47c5-8f21-68a8d26d92c1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:02.200982 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c9bfef19-66d7-47c5-8f21-68a8d26d92c1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:02.201462 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c9bfef19-66d7-47c5-8f21-68a8d26d92c1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:02.202270 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c9bfef19-66d7-47c5-8f21-68a8d26d92c1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:02.202746 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c9bfef19-66d7-47c5-8f21-68a8d26d92c1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:02.286837 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-429da136-2f9b-447a-b25c-6842e8e0105a tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05d80f13-c2e9-4a73-8d13-6241995ad167"}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:43:02.287910 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-429da136-2f9b-447a-b25c-6842e8e0105a tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:02.294375 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-429da136-2f9b-447a-b25c-6842e8e0105a tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:02.294831 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-429da136-2f9b-447a-b25c-6842e8e0105a tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:02.295599 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-429da136-2f9b-447a-b25c-6842e8e0105a tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:02.296035 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-429da136-2f9b-447a-b25c-6842e8e0105a tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:02.363617 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c9bfef19-66d7-47c5-8f21-68a8d26d92c1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:02.373256 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c9bfef19-66d7-47c5-8f21-68a8d26d92c1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:02.376359 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c9bfef19-66d7-47c5-8f21-68a8d26d92c1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:02.377720 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-c9bfef19-66d7-47c5-8f21-68a8d26d92c1 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1729 microversion: 2.20 time: 0.198170 May 26 12:43:02.378391 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 520/1048] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:43:02 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1729 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:03.396624 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f2ed707e-71a6-4f5d-9989-768ab8b1979b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:03.398852 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-f2ed707e-71a6-4f5d-9989-768ab8b1979b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:03.407255 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f2ed707e-71a6-4f5d-9989-768ab8b1979b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:03.407805 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f2ed707e-71a6-4f5d-9989-768ab8b1979b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:03.408837 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f2ed707e-71a6-4f5d-9989-768ab8b1979b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:03.409349 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f2ed707e-71a6-4f5d-9989-768ab8b1979b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:03.554269 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-f2ed707e-71a6-4f5d-9989-768ab8b1979b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:03.562436 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-f2ed707e-71a6-4f5d-9989-768ab8b1979b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:03.564080 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-f2ed707e-71a6-4f5d-9989-768ab8b1979b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:03.565282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-f2ed707e-71a6-4f5d-9989-768ab8b1979b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1729 microversion: 2.20 time: 0.173525 May 26 12:43:03.565838 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 521/1049] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:43:03 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:43:04.583871 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-970c872e-5be5-41a5-8451-137e84e528e9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:04.584607 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-970c872e-5be5-41a5-8451-137e84e528e9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:04.591068 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-970c872e-5be5-41a5-8451-137e84e528e9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:04.591520 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-970c872e-5be5-41a5-8451-137e84e528e9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:04.592277 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-970c872e-5be5-41a5-8451-137e84e528e9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:04.592734 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-970c872e-5be5-41a5-8451-137e84e528e9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:04.730885 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-970c872e-5be5-41a5-8451-137e84e528e9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:04.739024 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-970c872e-5be5-41a5-8451-137e84e528e9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:04.740549 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-970c872e-5be5-41a5-8451-137e84e528e9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:04.741753 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-970c872e-5be5-41a5-8451-137e84e528e9 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1729 microversion: 2.20 time: 0.161947 May 26 12:43:04.742327 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 522/1050] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:43:04 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:43:05.760603 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-423aa2ca-2c93-4153-8e58-ab703c3b6b0f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:05.761440 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-423aa2ca-2c93-4153-8e58-ab703c3b6b0f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:05.768358 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-423aa2ca-2c93-4153-8e58-ab703c3b6b0f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:05.768840 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-423aa2ca-2c93-4153-8e58-ab703c3b6b0f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:05.769646 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-423aa2ca-2c93-4153-8e58-ab703c3b6b0f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:05.770084 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-423aa2ca-2c93-4153-8e58-ab703c3b6b0f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:05.913796 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-423aa2ca-2c93-4153-8e58-ab703c3b6b0f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:05.921744 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-423aa2ca-2c93-4153-8e58-ab703c3b6b0f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:05.924212 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-423aa2ca-2c93-4153-8e58-ab703c3b6b0f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:05.925406 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-423aa2ca-2c93-4153-8e58-ab703c3b6b0f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1729 microversion: 2.20 time: 0.168779 May 26 12:43:05.925958 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 523/1051] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:43:05 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:43:06.944669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-0718bf62-b0e1-4830-b57e-b178100a8747 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:06.945409 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-0718bf62-b0e1-4830-b57e-b178100a8747 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:06.952058 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0718bf62-b0e1-4830-b57e-b178100a8747 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:06.952507 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0718bf62-b0e1-4830-b57e-b178100a8747 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:06.953333 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0718bf62-b0e1-4830-b57e-b178100a8747 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:06.953838 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0718bf62-b0e1-4830-b57e-b178100a8747 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:07.096115 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-0718bf62-b0e1-4830-b57e-b178100a8747 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:07.104274 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-0718bf62-b0e1-4830-b57e-b178100a8747 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:07.105819 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-0718bf62-b0e1-4830-b57e-b178100a8747 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:07.106964 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-0718bf62-b0e1-4830-b57e-b178100a8747 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1729 microversion: 2.20 time: 0.166230 May 26 12:43:07.107705 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 524/1052] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:43:06 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:43:08.125926 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-0b1c1293-89ff-4af6-a1d4-c16abf4ee395 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:08.126969 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-0b1c1293-89ff-4af6-a1d4-c16abf4ee395 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:08.133424 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0b1c1293-89ff-4af6-a1d4-c16abf4ee395 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:08.133954 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0b1c1293-89ff-4af6-a1d4-c16abf4ee395 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:08.134796 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0b1c1293-89ff-4af6-a1d4-c16abf4ee395 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:08.135305 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0b1c1293-89ff-4af6-a1d4-c16abf4ee395 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:08.276689 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-0b1c1293-89ff-4af6-a1d4-c16abf4ee395 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:08.286679 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-0b1c1293-89ff-4af6-a1d4-c16abf4ee395 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:08.288189 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-0b1c1293-89ff-4af6-a1d4-c16abf4ee395 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:08.289657 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-0b1c1293-89ff-4af6-a1d4-c16abf4ee395 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1729 microversion: 2.20 time: 0.167911 May 26 12:43:08.290531 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 525/1053] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:43:08 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:43:09.312427 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-a1121091-af8d-4097-92cb-5ad189bc416d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:09.314135 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-a1121091-af8d-4097-92cb-5ad189bc416d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:09.322647 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a1121091-af8d-4097-92cb-5ad189bc416d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:09.323090 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a1121091-af8d-4097-92cb-5ad189bc416d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:09.323862 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a1121091-af8d-4097-92cb-5ad189bc416d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:09.324300 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a1121091-af8d-4097-92cb-5ad189bc416d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:09.463126 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a1121091-af8d-4097-92cb-5ad189bc416d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:09.471545 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a1121091-af8d-4097-92cb-5ad189bc416d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:09.473076 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a1121091-af8d-4097-92cb-5ad189bc416d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:09.474233 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-a1121091-af8d-4097-92cb-5ad189bc416d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1729 microversion: 2.20 time: 0.166281 May 26 12:43:09.474811 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 526/1054] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:43:09 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:43:10.394944 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=2 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:10.492410 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-dc3f9e08-dc29-41bf-9375-f17c019e0666 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:10.493035 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-dc3f9e08-dc29-41bf-9375-f17c019e0666 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:10.499583 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-dc3f9e08-dc29-41bf-9375-f17c019e0666 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:10.500034 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-dc3f9e08-dc29-41bf-9375-f17c019e0666 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:10.500889 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-dc3f9e08-dc29-41bf-9375-f17c019e0666 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:10.501327 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-dc3f9e08-dc29-41bf-9375-f17c019e0666 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:10.639662 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-dc3f9e08-dc29-41bf-9375-f17c019e0666 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:10.648913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-dc3f9e08-dc29-41bf-9375-f17c019e0666 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:10.650384 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-dc3f9e08-dc29-41bf-9375-f17c019e0666 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:10.651560 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-dc3f9e08-dc29-41bf-9375-f17c019e0666 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1729 microversion: 2.20 time: 0.163059 May 26 12:43:10.652120 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 527/1055] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:43:10 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:43:11.669927 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-1dd48f0e-cc6c-43cb-b52b-e01da7e04c3d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:11.670611 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-1dd48f0e-cc6c-43cb-b52b-e01da7e04c3d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:11.677675 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1dd48f0e-cc6c-43cb-b52b-e01da7e04c3d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:11.678127 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1dd48f0e-cc6c-43cb-b52b-e01da7e04c3d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:11.678888 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1dd48f0e-cc6c-43cb-b52b-e01da7e04c3d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:11.679327 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1dd48f0e-cc6c-43cb-b52b-e01da7e04c3d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:11.808402 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-1dd48f0e-cc6c-43cb-b52b-e01da7e04c3d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:11.817016 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-1dd48f0e-cc6c-43cb-b52b-e01da7e04c3d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:11.818510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-1dd48f0e-cc6c-43cb-b52b-e01da7e04c3d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:11.819647 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-1dd48f0e-cc6c-43cb-b52b-e01da7e04c3d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1729 microversion: 2.20 time: 0.153717 May 26 12:43:11.820199 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 528/1056] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:43:11 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:43:12.291906 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=39 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:12.397578 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=8 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:12.837288 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-ff7c8c40-a021-4a24-a42d-c3ee14c98c3b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:12.838072 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-ff7c8c40-a021-4a24-a42d-c3ee14c98c3b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:12.844756 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ff7c8c40-a021-4a24-a42d-c3ee14c98c3b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:12.845513 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ff7c8c40-a021-4a24-a42d-c3ee14c98c3b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:12.846392 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ff7c8c40-a021-4a24-a42d-c3ee14c98c3b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:12.846831 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ff7c8c40-a021-4a24-a42d-c3ee14c98c3b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:12.984810 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ff7c8c40-a021-4a24-a42d-c3ee14c98c3b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:12.993492 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ff7c8c40-a021-4a24-a42d-c3ee14c98c3b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:12.995032 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ff7c8c40-a021-4a24-a42d-c3ee14c98c3b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:12.996176 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-ff7c8c40-a021-4a24-a42d-c3ee14c98c3b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1729 microversion: 2.20 time: 0.162849 May 26 12:43:12.996757 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 529/1057] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:43:12 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:43:14.015469 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-2ae554b6-ed89-473c-b14e-f1d03d512bed tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:14.016126 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-2ae554b6-ed89-473c-b14e-f1d03d512bed tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:14.019262 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=58 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:14.024458 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2ae554b6-ed89-473c-b14e-f1d03d512bed tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:14.024935 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2ae554b6-ed89-473c-b14e-f1d03d512bed tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:14.025696 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2ae554b6-ed89-473c-b14e-f1d03d512bed tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:14.026140 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2ae554b6-ed89-473c-b14e-f1d03d512bed tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:14.156217 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2ae554b6-ed89-473c-b14e-f1d03d512bed tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:14.164261 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2ae554b6-ed89-473c-b14e-f1d03d512bed tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:14.165841 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2ae554b6-ed89-473c-b14e-f1d03d512bed tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:14.166995 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-2ae554b6-ed89-473c-b14e-f1d03d512bed tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1729 microversion: 2.20 time: 0.155547 May 26 12:43:14.167552 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 530/1058] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:43:14 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:43:15.187402 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-0c00962e-8004-4bd3-9835-a20b2b3c8ec6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:15.188019 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-0c00962e-8004-4bd3-9835-a20b2b3c8ec6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:15.194618 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0c00962e-8004-4bd3-9835-a20b2b3c8ec6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:15.195068 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0c00962e-8004-4bd3-9835-a20b2b3c8ec6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:15.195865 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0c00962e-8004-4bd3-9835-a20b2b3c8ec6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:15.196335 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0c00962e-8004-4bd3-9835-a20b2b3c8ec6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:15.363004 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-0c00962e-8004-4bd3-9835-a20b2b3c8ec6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:15.371163 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-0c00962e-8004-4bd3-9835-a20b2b3c8ec6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:15.372693 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-0c00962e-8004-4bd3-9835-a20b2b3c8ec6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:15.373858 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-0c00962e-8004-4bd3-9835-a20b2b3c8ec6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1729 microversion: 2.20 time: 0.190447 May 26 12:43:15.374419 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 531/1059] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:43:15 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:43:15.993600 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-92d31606-b756-4931-a741-f9b950b570d6 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:15.994092 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-92d31606-b756-4931-a741-f9b950b570d6 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:16.002592 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-92d31606-b756-4931-a741-f9b950b570d6 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:16.003043 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-92d31606-b756-4931-a741-f9b950b570d6 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:16.003810 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-92d31606-b756-4931-a741-f9b950b570d6 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:16.004235 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-92d31606-b756-4931-a741-f9b950b570d6 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:16.036805 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-92d31606-b756-4931-a741-f9b950b570d6 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Going to try to terminate instance {{(pid=124134) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:43:16.096629 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:16.132335 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-92d31606-b756-4931-a741-f9b950b570d6 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 204 len: 0 microversion: 2.1 time: 0.142551 May 26 12:43:16.132977 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 532/1060] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:43:15 2022] DELETE /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:43:16.138084 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-b9ed6f35-acfb-4a1e-a940-23e6b32c69f9 req-91e57312-25ff-494f-b233-1cb8c08e9f43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a42e497c-0646-4450-9f42-f8da46762273", "tag": "e2c6e6e5-7173-4fde-a2ee-0c73b6a833ac"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:43:16.149410 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-b9ed6f35-acfb-4a1e-a940-23e6b32c69f9 req-91e57312-25ff-494f-b233-1cb8c08e9f43 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:16.149855 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-b9ed6f35-acfb-4a1e-a940-23e6b32c69f9 req-91e57312-25ff-494f-b233-1cb8c08e9f43 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:16.165229 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-b9ed6f35-acfb-4a1e-a940-23e6b32c69f9 req-91e57312-25ff-494f-b233-1cb8c08e9f43 service nova] Creating event network-changed:e2c6e6e5-7173-4fde-a2ee-0c73b6a833ac for instance a42e497c-0646-4450-9f42-f8da46762273 on hv-cinder-81514 May 26 12:43:16.171083 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-b9ed6f35-acfb-4a1e-a940-23e6b32c69f9 req-91e57312-25ff-494f-b233-1cb8c08e9f43 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036793 May 26 12:43:16.171856 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 533/1061] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:43:16.178143 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b082f348-c6d6-41bb-9c2a-ac9584236b8b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:16.179227 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b082f348-c6d6-41bb-9c2a-ac9584236b8b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:16.185846 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b082f348-c6d6-41bb-9c2a-ac9584236b8b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:16.186299 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b082f348-c6d6-41bb-9c2a-ac9584236b8b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:16.187072 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b082f348-c6d6-41bb-9c2a-ac9584236b8b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:16.187508 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b082f348-c6d6-41bb-9c2a-ac9584236b8b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:16.349554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b082f348-c6d6-41bb-9c2a-ac9584236b8b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:16.357659 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b082f348-c6d6-41bb-9c2a-ac9584236b8b tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1570 microversion: 2.1 time: 0.184734 May 26 12:43:16.358239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 534/1062] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:43:16 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1570 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:16.391687 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f6ad6a56-b57e-4620-8064-12e7fdf308ad tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:16.392325 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-f6ad6a56-b57e-4620-8064-12e7fdf308ad tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:16.398726 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f6ad6a56-b57e-4620-8064-12e7fdf308ad tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:16.399181 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f6ad6a56-b57e-4620-8064-12e7fdf308ad tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:16.399958 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f6ad6a56-b57e-4620-8064-12e7fdf308ad tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:16.400403 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f6ad6a56-b57e-4620-8064-12e7fdf308ad tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:16.546556 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-f6ad6a56-b57e-4620-8064-12e7fdf308ad tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:16.555390 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-f6ad6a56-b57e-4620-8064-12e7fdf308ad tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:16.557432 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-f6ad6a56-b57e-4620-8064-12e7fdf308ad tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:16.558914 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-f6ad6a56-b57e-4620-8064-12e7fdf308ad tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1729 microversion: 2.20 time: 0.171437 May 26 12:43:16.559512 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 535/1063] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:43:16 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:43:17.376205 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-86d7e132-155a-4d66-a1cc-13aff5ce5060 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:17.377089 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-86d7e132-155a-4d66-a1cc-13aff5ce5060 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:17.383611 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-86d7e132-155a-4d66-a1cc-13aff5ce5060 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:17.384054 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-86d7e132-155a-4d66-a1cc-13aff5ce5060 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:17.384843 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-86d7e132-155a-4d66-a1cc-13aff5ce5060 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:17.385275 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-86d7e132-155a-4d66-a1cc-13aff5ce5060 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:17.521217 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-86d7e132-155a-4d66-a1cc-13aff5ce5060 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:17.528700 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-86d7e132-155a-4d66-a1cc-13aff5ce5060 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1570 microversion: 2.1 time: 0.156585 May 26 12:43:17.529290 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 536/1064] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:43:17 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:43:17.579710 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b02b2aae-9c44-4bd7-a888-e477fcdfd9a7 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:17.580443 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b02b2aae-9c44-4bd7-a888-e477fcdfd9a7 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:17.586856 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b02b2aae-9c44-4bd7-a888-e477fcdfd9a7 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:17.587328 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b02b2aae-9c44-4bd7-a888-e477fcdfd9a7 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:17.588126 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b02b2aae-9c44-4bd7-a888-e477fcdfd9a7 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:17.588581 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b02b2aae-9c44-4bd7-a888-e477fcdfd9a7 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:17.723662 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b02b2aae-9c44-4bd7-a888-e477fcdfd9a7 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:17.731481 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b02b2aae-9c44-4bd7-a888-e477fcdfd9a7 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:17.733006 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b02b2aae-9c44-4bd7-a888-e477fcdfd9a7 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:17.734239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b02b2aae-9c44-4bd7-a888-e477fcdfd9a7 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1729 microversion: 2.20 time: 0.158958 May 26 12:43:17.734866 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 537/1065] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:43:17 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:43:18.546995 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-2fd85bc3-710b-4c8e-9e6d-db39fbf0d651 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:18.547609 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-2fd85bc3-710b-4c8e-9e6d-db39fbf0d651 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:18.556282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2fd85bc3-710b-4c8e-9e6d-db39fbf0d651 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:18.556761 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2fd85bc3-710b-4c8e-9e6d-db39fbf0d651 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:18.557546 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2fd85bc3-710b-4c8e-9e6d-db39fbf0d651 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:18.558072 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2fd85bc3-710b-4c8e-9e6d-db39fbf0d651 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:18.691472 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-2fd85bc3-710b-4c8e-9e6d-db39fbf0d651 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:18.699055 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-2fd85bc3-710b-4c8e-9e6d-db39fbf0d651 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1570 microversion: 2.1 time: 0.156121 May 26 12:43:18.699628 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 538/1066] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:43:18 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:43:18.752794 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-4a23a18e-4f1b-41fb-9b78-a1a64100221e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:18.753393 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-4a23a18e-4f1b-41fb-9b78-a1a64100221e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:18.759256 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4a23a18e-4f1b-41fb-9b78-a1a64100221e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:18.759699 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4a23a18e-4f1b-41fb-9b78-a1a64100221e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:18.760446 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4a23a18e-4f1b-41fb-9b78-a1a64100221e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:18.760921 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4a23a18e-4f1b-41fb-9b78-a1a64100221e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:18.897898 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-4a23a18e-4f1b-41fb-9b78-a1a64100221e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:18.905749 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-4a23a18e-4f1b-41fb-9b78-a1a64100221e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:18.907255 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-4a23a18e-4f1b-41fb-9b78-a1a64100221e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:18.909779 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-4a23a18e-4f1b-41fb-9b78-a1a64100221e tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1729 microversion: 2.20 time: 0.160926 May 26 12:43:18.910331 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 539/1067] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:43:18 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:43:19.143977 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-429da136-2f9b-447a-b25c-6842e8e0105a tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "POST /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 16.860899 May 26 12:43:19.145350 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 529/1068] 10.222.0.39 () {60 vars in 1322 bytes} [Thu May 26 12:43:02 2022] POST /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9/os-volume_attachments => generated 194 bytes in 16864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:43:19.717270 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-d9df09a7-8291-4c0e-91a2-4cc9547bd015 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:19.717880 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-d9df09a7-8291-4c0e-91a2-4cc9547bd015 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:19.724431 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d9df09a7-8291-4c0e-91a2-4cc9547bd015 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:19.724920 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d9df09a7-8291-4c0e-91a2-4cc9547bd015 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:19.725679 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d9df09a7-8291-4c0e-91a2-4cc9547bd015 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:19.726119 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d9df09a7-8291-4c0e-91a2-4cc9547bd015 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:19.861399 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d9df09a7-8291-4c0e-91a2-4cc9547bd015 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:19.868874 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-d9df09a7-8291-4c0e-91a2-4cc9547bd015 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1570 microversion: 2.1 time: 0.155440 May 26 12:43:19.869433 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 540/1069] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:43:19 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:19.928955 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-1f55995b-7974-423e-9008-7fe1fe9f9213 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:19.929949 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-1f55995b-7974-423e-9008-7fe1fe9f9213 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:19.936940 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1f55995b-7974-423e-9008-7fe1fe9f9213 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:19.937394 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1f55995b-7974-423e-9008-7fe1fe9f9213 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:19.939795 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1f55995b-7974-423e-9008-7fe1fe9f9213 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:19.940240 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1f55995b-7974-423e-9008-7fe1fe9f9213 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:20.207634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-1f55995b-7974-423e-9008-7fe1fe9f9213 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:20.216737 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-1f55995b-7974-423e-9008-7fe1fe9f9213 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:20.218521 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-1f55995b-7974-423e-9008-7fe1fe9f9213 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:20.221640 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-1f55995b-7974-423e-9008-7fe1fe9f9213 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1729 microversion: 2.20 time: 0.297270 May 26 12:43:20.232342 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 530/1070] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:43:19 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1729 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:20.483641 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-c1e007a1-6e5b-41da-8c28-711aecb11537 req-600d1a71-61d6-4de7-a5ed-fb684e3bab2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a42e497c-0646-4450-9f42-f8da46762273", "name": "network-vif-deleted", "tag": "e2c6e6e5-7173-4fde-a2ee-0c73b6a833ac"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:43:20.493631 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-c1e007a1-6e5b-41da-8c28-711aecb11537 req-600d1a71-61d6-4de7-a5ed-fb684e3bab2b service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:20.494079 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-c1e007a1-6e5b-41da-8c28-711aecb11537 req-600d1a71-61d6-4de7-a5ed-fb684e3bab2b service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:20.506403 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-c1e007a1-6e5b-41da-8c28-711aecb11537 req-600d1a71-61d6-4de7-a5ed-fb684e3bab2b service nova] Creating event network-vif-deleted:e2c6e6e5-7173-4fde-a2ee-0c73b6a833ac for instance a42e497c-0646-4450-9f42-f8da46762273 on hv-cinder-81514 May 26 12:43:20.512787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-c1e007a1-6e5b-41da-8c28-711aecb11537 req-600d1a71-61d6-4de7-a5ed-fb684e3bab2b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032791 May 26 12:43:20.513326 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 541/1071] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:43:20.886649 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-a3188afe-d9bf-4572-8617-28ca39be04e3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:20.887494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-a3188afe-d9bf-4572-8617-28ca39be04e3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:20.896059 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a3188afe-d9bf-4572-8617-28ca39be04e3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:20.896511 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a3188afe-d9bf-4572-8617-28ca39be04e3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:20.897314 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a3188afe-d9bf-4572-8617-28ca39be04e3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:20.897748 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a3188afe-d9bf-4572-8617-28ca39be04e3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:20.962201 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-a3188afe-d9bf-4572-8617-28ca39be04e3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a068f31da9dc4b589e649e4ec5cf713f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de5263b784723aca0332e63f6309e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:20.970482 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-a3188afe-d9bf-4572-8617-28ca39be04e3 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 200 len: 1220 microversion: 2.1 time: 0.087680 May 26 12:43:20.971061 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 531/1072] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:43:20 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:21.240558 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f786fcae-5a41-4656-8bea-0bb229f11524 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:21.241304 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-f786fcae-5a41-4656-8bea-0bb229f11524 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:21.247934 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f786fcae-5a41-4656-8bea-0bb229f11524 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:21.248373 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f786fcae-5a41-4656-8bea-0bb229f11524 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:21.249165 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f786fcae-5a41-4656-8bea-0bb229f11524 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:21.249612 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f786fcae-5a41-4656-8bea-0bb229f11524 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:21.418868 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-f786fcae-5a41-4656-8bea-0bb229f11524 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:21.429810 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-95f9ad4e-b3d7-4041-8a03-a53844760fab req-d5cbc7ae-9971-4660-af98-a1b7dc186623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2", "name": "network-vif-plugged", "status": "completed", "tag": "c3caaa3d-4347-42cd-a614-454eabf81b41"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:43:21.432075 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-f786fcae-5a41-4656-8bea-0bb229f11524 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:21.433900 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-f786fcae-5a41-4656-8bea-0bb229f11524 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:21.435088 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-f786fcae-5a41-4656-8bea-0bb229f11524 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1729 microversion: 2.20 time: 0.199384 May 26 12:43:21.435682 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 542/1073] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:43:21 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1729 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:43:21.452771 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-95f9ad4e-b3d7-4041-8a03-a53844760fab req-d5cbc7ae-9971-4660-af98-a1b7dc186623 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:21.453164 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-95f9ad4e-b3d7-4041-8a03-a53844760fab req-d5cbc7ae-9971-4660-af98-a1b7dc186623 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:21.465925 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-95f9ad4e-b3d7-4041-8a03-a53844760fab req-d5cbc7ae-9971-4660-af98-a1b7dc186623 service nova] Creating event network-vif-plugged:c3caaa3d-4347-42cd-a614-454eabf81b41 for instance f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 on hv-cinder-81514 May 26 12:43:21.472260 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-95f9ad4e-b3d7-4041-8a03-a53844760fab req-d5cbc7ae-9971-4660-af98-a1b7dc186623 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047770 May 26 12:43:21.473239 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 532/1074] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:43:21.987525 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-213e891d-ee0a-451c-88ad-13449fbb59c2 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:21.988273 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-213e891d-ee0a-451c-88ad-13449fbb59c2 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] [instance: a42e497c-0646-4450-9f42-f8da46762273] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:21.994584 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-213e891d-ee0a-451c-88ad-13449fbb59c2 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:21.995131 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-213e891d-ee0a-451c-88ad-13449fbb59c2 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:21.995977 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-213e891d-ee0a-451c-88ad-13449fbb59c2 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:21.996545 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-213e891d-ee0a-451c-88ad-13449fbb59c2 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:22.011456 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.wsgi [None req-213e891d-ee0a-451c-88ad-13449fbb59c2 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] HTTP exception thrown: Instance a42e497c-0646-4450-9f42-f8da46762273 could not be found. May 26 12:43:22.013121 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-213e891d-ee0a-451c-88ad-13449fbb59c2 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Request method failure captured: May 26 12:43:22.013121 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: request: GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 HTTP/1.1 May 26 12:43:22.013121 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept: application/json May 26 12:43:22.013121 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept-Encoding: identity May 26 12:43:22.013121 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Connection: close May 26 12:43:22.013121 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Length: 0 May 26 12:43:22.013121 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Type: application/json May 26 12:43:22.013121 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Host: 10.222.0.39 May 26 12:43:22.013121 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Openstack-System-Scope: None May 26 12:43:22.013121 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: User-Agent: python-urllib3/1.26.9 May 26 12:43:22.013121 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Auth-Token: gAAAAABij3ROz-Yz7p6WvPeRjP6qeviA7oFR2PZIJtym6SRyMILucdkxN0VVxGPjiN8M6-A4oWtMA7gensVu2Q3flESCn8j9_3qEeskBUPmuaK_43kPAj6PVbmBLYKWM6imz7zZ7ZiZNNNV9GBeN5pV4iG61C3ngRRgc1A50eWalQYYeGNru_Ss May 26 12:43:22.013121 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Id: None May 26 12:43:22.013121 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Name: None May 26 12:43:22.013121 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Identity-Status: Confirmed May 26 12:43:22.013121 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Is-Admin-Project: True May 26 12:43:22.013121 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Id: default May 26 12:43:22.013121 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Name: Default May 26 12:43:22.013121 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Id: ce0de5263b784723aca0332e63f6309e May 26 12:43:22.013121 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Name: tempest-TestShelveInstance-2025357708 May 26 12:43:22.013121 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Role: member,reader May 26 12:43:22.013121 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Roles: member,reader May 26 12:43:22.014764 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ce0de5263b784723aca0332e63f6309e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ce0de5263b784723aca0332e63f6309e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ce0de5263b784723aca0332e63f6309e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ce0de5263b784723aca0332e63f6309e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:43:22.014764 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant: tempest-TestShelveInstance-2025357708 May 26 12:43:22.014764 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Id: ce0de5263b784723aca0332e63f6309e May 26 12:43:22.014764 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Name: tempest-TestShelveInstance-2025357708 May 26 12:43:22.014764 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User: tempest-TestShelveInstance-2025357708-project May 26 12:43:22.014764 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Id: default May 26 12:43:22.014764 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Name: Default May 26 12:43:22.014764 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Id: a068f31da9dc4b589e649e4ec5cf713f May 26 12:43:22.014764 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Name: tempest-TestShelveInstance-2025357708-project May 26 12:43:22.014764 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: method: > May 26 12:43:22.014764 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: exception: Instance a42e497c-0646-4450-9f42-f8da46762273 could not be found. May 26 12:43:22.014764 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: action_args: {'id': 'a42e497c-0646-4450-9f42-f8da46762273'} May 26 12:43:22.015739 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:43:22.015739 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:43:22.015739 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:43:22.015739 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:43:22.015739 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:43:22.015739 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:43:22.015739 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:43:22.015739 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:43:22.015739 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:43:22.015739 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:43:22.015739 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a42e497c-0646-4450-9f42-f8da46762273 could not be found. May 26 12:43:22.015739 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:43:22.015739 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:43:22.015739 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:43:22.015739 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:43:22.015739 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:43:22.015739 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:43:22.015739 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:43:22.015739 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:43:22.015739 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:43:22.018500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:43:22.018500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:43:22.018500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:43:22.018500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:43:22.018500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:43:22.018500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:43:22.018500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:43:22.018500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a42e497c-0646-4450-9f42-f8da46762273 could not be found. May 26 12:43:22.018500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:43:22.018500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:43:22.018500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:43:22.018500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:43:22.018500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:43:22.018500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:43:22.018500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:43:22.018500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:43:22.018500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a42e497c-0646-4450-9f42-f8da46762273 could not be found. May 26 12:43:22.018500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:43:22.019940 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-213e891d-ee0a-451c-88ad-13449fbb59c2 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Returning 404 to user: Instance a42e497c-0646-4450-9f42-f8da46762273 could not be found. {{(pid=124134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:43:22.019940 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-213e891d-ee0a-451c-88ad-13449fbb59c2 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273" status: 404 len: 111 microversion: 2.1 time: 0.031042 May 26 12:43:22.019940 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 543/1075] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:43:21 2022] GET /compute/v2.1/servers/a42e497c-0646-4450-9f42-f8da46762273 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:43:22.178294 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-a041e64c-a7cf-49fb-a9bc-24cdcb49f679 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] Calling method '.version_select at 0x7fed3134ae50>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:22.213505 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-a041e64c-a7cf-49fb-a9bc-24cdcb49f679 tempest-TestShelveInstance-2025357708 tempest-TestShelveInstance-2025357708-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1721011571" status: 202 len: 0 microversion: 2.1 time: 0.039417 May 26 12:43:22.214545 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 533/1076] 10.222.0.39 () {58 vars in 1253 bytes} [Thu May 26 12:43:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1721011571 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:43:22.453969 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-3aabee9c-08b0-4146-9314-89e23a5af022 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:22.455430 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-3aabee9c-08b0-4146-9314-89e23a5af022 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:22.462130 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3aabee9c-08b0-4146-9314-89e23a5af022 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:22.462578 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3aabee9c-08b0-4146-9314-89e23a5af022 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:22.463335 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3aabee9c-08b0-4146-9314-89e23a5af022 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:22.463767 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3aabee9c-08b0-4146-9314-89e23a5af022 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:22.715581 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-3aabee9c-08b0-4146-9314-89e23a5af022 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:22.724499 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-3aabee9c-08b0-4146-9314-89e23a5af022 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:22.726040 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-3aabee9c-08b0-4146-9314-89e23a5af022 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:22.727250 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-3aabee9c-08b0-4146-9314-89e23a5af022 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1729 microversion: 2.20 time: 0.277403 May 26 12:43:22.727794 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 544/1077] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:43:22 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1729 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:23.745812 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-555fe06c-a5b6-4fbe-8507-4929dfa4eade tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:23.746676 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-555fe06c-a5b6-4fbe-8507-4929dfa4eade tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:23.754593 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-555fe06c-a5b6-4fbe-8507-4929dfa4eade tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:23.755163 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-555fe06c-a5b6-4fbe-8507-4929dfa4eade tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:23.756013 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-555fe06c-a5b6-4fbe-8507-4929dfa4eade tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:23.756521 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-555fe06c-a5b6-4fbe-8507-4929dfa4eade tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:23.995154 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-555fe06c-a5b6-4fbe-8507-4929dfa4eade tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:24.007760 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-555fe06c-a5b6-4fbe-8507-4929dfa4eade tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:24.009576 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-555fe06c-a5b6-4fbe-8507-4929dfa4eade tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:24.011212 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-555fe06c-a5b6-4fbe-8507-4929dfa4eade tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1729 microversion: 2.20 time: 0.269390 May 26 12:43:24.015640 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 534/1078] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:43:23 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1729 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:25.039240 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-86fcb79b-d74e-4427-9310-ab6bb010030f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:25.039853 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-86fcb79b-d74e-4427-9310-ab6bb010030f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:25.046558 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-86fcb79b-d74e-4427-9310-ab6bb010030f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:25.047020 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-86fcb79b-d74e-4427-9310-ab6bb010030f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:25.047790 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-86fcb79b-d74e-4427-9310-ab6bb010030f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:25.048444 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-86fcb79b-d74e-4427-9310-ab6bb010030f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:25.254032 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-86fcb79b-d74e-4427-9310-ab6bb010030f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:25.263688 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-86fcb79b-d74e-4427-9310-ab6bb010030f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:25.265246 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-86fcb79b-d74e-4427-9310-ab6bb010030f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:25.266683 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-86fcb79b-d74e-4427-9310-ab6bb010030f tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1716 microversion: 2.20 time: 0.231210 May 26 12:43:25.268496 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 545/1079] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:43:25 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1716 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:43:27.834120 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e596af90-1b83-4f9b-b1d2-f0169229e1ac tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:27.834644 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e596af90-1b83-4f9b-b1d2-f0169229e1ac tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:27.841500 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e596af90-1b83-4f9b-b1d2-f0169229e1ac tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:27.841949 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e596af90-1b83-4f9b-b1d2-f0169229e1ac tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:27.843041 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e596af90-1b83-4f9b-b1d2-f0169229e1ac tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:27.844030 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e596af90-1b83-4f9b-b1d2-f0169229e1ac tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:27.997019 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e596af90-1b83-4f9b-b1d2-f0169229e1ac tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:28.005328 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e596af90-1b83-4f9b-b1d2-f0169229e1ac tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1595 microversion: 2.1 time: 0.176025 May 26 12:43:28.005908 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 535/1080] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:43:27 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1595 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:30.218690 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-fdaffbb2-5130-475b-99cf-8fe1fe1befd8 req-cfc317d1-79ad-49b2-a7c5-c29345673d3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a15a237-ed0e-403f-812e-805d26cd19b9", "tag": "3be3d457-3848-425b-9df9-3a6ed2996a1e"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:43:30.241945 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-fdaffbb2-5130-475b-99cf-8fe1fe1befd8 req-cfc317d1-79ad-49b2-a7c5-c29345673d3a service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:30.243074 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-fdaffbb2-5130-475b-99cf-8fe1fe1befd8 req-cfc317d1-79ad-49b2-a7c5-c29345673d3a service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:30.270897 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-fdaffbb2-5130-475b-99cf-8fe1fe1befd8 req-cfc317d1-79ad-49b2-a7c5-c29345673d3a service nova] Creating event network-changed:3be3d457-3848-425b-9df9-3a6ed2996a1e for instance 1a15a237-ed0e-403f-812e-805d26cd19b9 on hv-cinder-81514 May 26 12:43:30.277123 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-fdaffbb2-5130-475b-99cf-8fe1fe1befd8 req-cfc317d1-79ad-49b2-a7c5-c29345673d3a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061965 May 26 12:43:30.278677 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 546/1081] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:43:31.986624 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e03f78bd-2bcc-4bb3-bc10-dbfd9687c3d4 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-921077384"}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:43:31.987139 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e03f78bd-2bcc-4bb3-bc10-dbfd9687c3d4 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:31.993969 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e03f78bd-2bcc-4bb3-bc10-dbfd9687c3d4 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:31.994399 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e03f78bd-2bcc-4bb3-bc10-dbfd9687c3d4 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:31.995164 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e03f78bd-2bcc-4bb3-bc10-dbfd9687c3d4 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:31.995606 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e03f78bd-2bcc-4bb3-bc10-dbfd9687c3d4 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:32.128997 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.network.security_group_api [None req-e03f78bd-2bcc-4bb3-bc10-dbfd9687c3d4 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Adding security group 3044dde1-bcac-4f8c-8078-6a0d6bbda0dd to port 3be3d457-3848-425b-9df9-3a6ed2996a1e May 26 12:43:32.511605 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e03f78bd-2bcc-4bb3-bc10-dbfd9687c3d4 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "POST /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9/action" status: 202 len: 0 microversion: 2.1 time: 0.529372 May 26 12:43:32.512986 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 536/1082] 10.222.0.39 () {60 vars in 1277 bytes} [Thu May 26 12:43:31 2022] POST /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 12:43:32.522759 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-13c60fae-6220-4478-8a1b-7f6bd8b80ae2 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:32.524201 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-13c60fae-6220-4478-8a1b-7f6bd8b80ae2 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:32.532925 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-d403394e-ab94-49c0-b69c-037e37bd7725 req-1340198b-bc05-42c6-a412-fb5ec2ce4da4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a15a237-ed0e-403f-812e-805d26cd19b9", "tag": "3be3d457-3848-425b-9df9-3a6ed2996a1e"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:43:32.541689 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-13c60fae-6220-4478-8a1b-7f6bd8b80ae2 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:32.542133 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-13c60fae-6220-4478-8a1b-7f6bd8b80ae2 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:32.542898 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-13c60fae-6220-4478-8a1b-7f6bd8b80ae2 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:32.543874 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-13c60fae-6220-4478-8a1b-7f6bd8b80ae2 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:32.558685 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-d403394e-ab94-49c0-b69c-037e37bd7725 req-1340198b-bc05-42c6-a412-fb5ec2ce4da4 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:32.559377 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-d403394e-ab94-49c0-b69c-037e37bd7725 req-1340198b-bc05-42c6-a412-fb5ec2ce4da4 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:32.582686 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-d403394e-ab94-49c0-b69c-037e37bd7725 req-1340198b-bc05-42c6-a412-fb5ec2ce4da4 service nova] Creating event network-changed:3be3d457-3848-425b-9df9-3a6ed2996a1e for instance 1a15a237-ed0e-403f-812e-805d26cd19b9 on hv-cinder-81514 May 26 12:43:32.593027 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-d403394e-ab94-49c0-b69c-037e37bd7725 req-1340198b-bc05-42c6-a412-fb5ec2ce4da4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067143 May 26 12:43:32.593952 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 537/1083] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:43:32.758362 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-13c60fae-6220-4478-8a1b-7f6bd8b80ae2 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:43:32.768266 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-13c60fae-6220-4478-8a1b-7f6bd8b80ae2 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1760 microversion: 2.1 time: 0.249754 May 26 12:43:32.769567 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 547/1084] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:43:32 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1760 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:52.473925 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:52.474684 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:52.478802 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-085e55cd-237e-4857-913b-385a0a122040 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:52.479371 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-085e55cd-237e-4857-913b-385a0a122040 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:52.488092 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-085e55cd-237e-4857-913b-385a0a122040 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:52.488550 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-085e55cd-237e-4857-913b-385a0a122040 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:52.489322 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-085e55cd-237e-4857-913b-385a0a122040 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:52.489759 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-085e55cd-237e-4857-913b-385a0a122040 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:52.513517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-085e55cd-237e-4857-913b-385a0a122040 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d/ips" status: 200 len: 146 microversion: 2.1 time: 0.041151 May 26 12:43:52.514074 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 538/1085] 10.222.0.39 () {58 vars in 1247 bytes} [Thu May 26 12:43:52 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:43:53.827377 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-5457a635-ec5b-40c6-8547-183a74735ddd tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f244bbcc-fdff-401d-968b-3dc38fba490c"}} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:43:53.828488 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-5457a635-ec5b-40c6-8547-183a74735ddd tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:43:53.831239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:53.831893 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=74 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:53.838045 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5457a635-ec5b-40c6-8547-183a74735ddd tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:53.838548 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5457a635-ec5b-40c6-8547-183a74735ddd tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:53.839300 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5457a635-ec5b-40c6-8547-183a74735ddd tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:53.839730 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5457a635-ec5b-40c6-8547-183a74735ddd tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:54.097035 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-5457a635-ec5b-40c6-8547-183a74735ddd tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "POST /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273707 May 26 12:43:54.097858 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 548/1086] 10.222.0.39 () {60 vars in 1322 bytes} [Thu May 26 12:43:53 2022] POST /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:01.595562 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-3d901a11-1dc6-440d-9826-c912d76f7877 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:01.596494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-3d901a11-1dc6-440d-9826-c912d76f7877 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:01.604304 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3d901a11-1dc6-440d-9826-c912d76f7877 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:01.604785 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3d901a11-1dc6-440d-9826-c912d76f7877 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:01.605567 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3d901a11-1dc6-440d-9826-c912d76f7877 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:01.606008 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3d901a11-1dc6-440d-9826-c912d76f7877 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:01.635737 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-3d901a11-1dc6-440d-9826-c912d76f7877 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044059 May 26 12:44:01.636302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 539/1087] 10.222.0.39 () {58 vars in 1301 bytes} [Thu May 26 12:44:01 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:44:01.646918 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-65366830-01fb-4326-8fef-41f69340df89 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:01.648160 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-65366830-01fb-4326-8fef-41f69340df89 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:01.654827 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-65366830-01fb-4326-8fef-41f69340df89 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:01.655274 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-65366830-01fb-4326-8fef-41f69340df89 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:01.656026 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-65366830-01fb-4326-8fef-41f69340df89 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:01.656460 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-65366830-01fb-4326-8fef-41f69340df89 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:01.685043 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-65366830-01fb-4326-8fef-41f69340df89 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d/os-volume_attachments/f244bbcc-fdff-401d-968b-3dc38fba490c" status: 200 len: 194 microversion: 2.1 time: 0.042662 May 26 12:44:01.685614 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 549/1088] 10.222.0.39 () {58 vars in 1412 bytes} [Thu May 26 12:44:01 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d/os-volume_attachments/f244bbcc-fdff-401d-968b-3dc38fba490c => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:44:03.000549 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-a2d8b1d1-5c59-41f6-af5d-4d415304c626 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f40a1d9-e173-4194-ba08-7007c309d37c"}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:44:03.001613 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-a2d8b1d1-5c59-41f6-af5d-4d415304c626 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:03.008120 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a2d8b1d1-5c59-41f6-af5d-4d415304c626 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:03.008568 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a2d8b1d1-5c59-41f6-af5d-4d415304c626 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:03.009370 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a2d8b1d1-5c59-41f6-af5d-4d415304c626 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:03.009809 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a2d8b1d1-5c59-41f6-af5d-4d415304c626 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:03.262420 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-a2d8b1d1-5c59-41f6-af5d-4d415304c626 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "POST /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265611 May 26 12:44:03.263039 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 540/1089] 10.222.0.39 () {60 vars in 1322 bytes} [Thu May 26 12:44:02 2022] POST /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:44:10.764929 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e59560f0-746b-48b3-8fa7-23578e0ae808 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:10.765978 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-e59560f0-746b-48b3-8fa7-23578e0ae808 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:10.773363 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e59560f0-746b-48b3-8fa7-23578e0ae808 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:10.773814 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e59560f0-746b-48b3-8fa7-23578e0ae808 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:10.774572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e59560f0-746b-48b3-8fa7-23578e0ae808 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:10.775007 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e59560f0-746b-48b3-8fa7-23578e0ae808 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:10.804991 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-e59560f0-746b-48b3-8fa7-23578e0ae808 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043909 May 26 12:44:10.805530 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 550/1090] 10.222.0.39 () {58 vars in 1301 bytes} [Thu May 26 12:44:10 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:10.953108 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-7e40820b-fa93-4a96-9eba-9e0ba422cb14 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:10.953689 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-7e40820b-fa93-4a96-9eba-9e0ba422cb14 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:10.959893 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7e40820b-fa93-4a96-9eba-9e0ba422cb14 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:10.960954 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7e40820b-fa93-4a96-9eba-9e0ba422cb14 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:10.961838 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7e40820b-fa93-4a96-9eba-9e0ba422cb14 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:10.962292 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7e40820b-fa93-4a96-9eba-9e0ba422cb14 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:10.990603 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-7e40820b-fa93-4a96-9eba-9e0ba422cb14 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d/os-volume_attachments/f244bbcc-fdff-401d-968b-3dc38fba490c" status: 200 len: 194 microversion: 2.1 time: 0.042318 May 26 12:44:10.991183 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 541/1091] 10.222.0.39 () {58 vars in 1412 bytes} [Thu May 26 12:44:10 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d/os-volume_attachments/f244bbcc-fdff-401d-968b-3dc38fba490c => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:11.001065 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-2af8db44-b75d-4ea7-84f7-566b485fd380 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:11.001560 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-2af8db44-b75d-4ea7-84f7-566b485fd380 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:11.008100 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2af8db44-b75d-4ea7-84f7-566b485fd380 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:11.008567 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-cb655925-64e7-41fd-a859-146d899f316f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:11.008705 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2af8db44-b75d-4ea7-84f7-566b485fd380 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:11.009096 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-cb655925-64e7-41fd-a859-146d899f316f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:11.009353 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2af8db44-b75d-4ea7-84f7-566b485fd380 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:11.009787 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2af8db44-b75d-4ea7-84f7-566b485fd380 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:11.015165 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cb655925-64e7-41fd-a859-146d899f316f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:11.015621 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cb655925-64e7-41fd-a859-146d899f316f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:11.016419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cb655925-64e7-41fd-a859-146d899f316f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:11.016885 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-cb655925-64e7-41fd-a859-146d899f316f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:11.041284 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-cb655925-64e7-41fd-a859-146d899f316f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6/ips" status: 200 len: 150 microversion: 2.1 time: 0.037016 May 26 12:44:11.042157 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 542/1092] 10.222.0.39 () {58 vars in 1247 bytes} [Thu May 26 12:44:11 2022] GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:11.096602 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.objects.instance [None req-2af8db44-b75d-4ea7-84f7-566b485fd380 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lazy-loading 'services' on Instance uuid 411d94dd-76cb-418b-bfac-d1948a57f92d {{(pid=124134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:44:11.172491 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-2af8db44-b75d-4ea7-84f7-566b485fd380 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "DELETE /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d/os-volume_attachments/f244bbcc-fdff-401d-968b-3dc38fba490c" status: 202 len: 0 microversion: 2.1 time: 0.175230 May 26 12:44:11.173363 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 551/1093] 10.222.0.39 () {58 vars in 1415 bytes} [Thu May 26 12:44:10 2022] DELETE /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d/os-volume_attachments/f244bbcc-fdff-401d-968b-3dc38fba490c => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:44:12.379080 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-c45148b1-862d-4409-bfda-47514af624d6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eccd69f2-6196-4689-ab3f-299fd2b060a2"}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:44:12.380143 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-c45148b1-862d-4409-bfda-47514af624d6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:12.387305 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c45148b1-862d-4409-bfda-47514af624d6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:12.387758 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c45148b1-862d-4409-bfda-47514af624d6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:12.388513 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c45148b1-862d-4409-bfda-47514af624d6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:12.388982 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c45148b1-862d-4409-bfda-47514af624d6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:12.671229 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-c45148b1-862d-4409-bfda-47514af624d6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "POST /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296070 May 26 12:44:12.671872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 543/1094] 10.222.0.39 () {60 vars in 1322 bytes} [Thu May 26 12:44:12 2022] POST /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:13.347594 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-a4995e54-04a8-45e0-ad84-1d7847d9e0bd tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:13.348170 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-a4995e54-04a8-45e0-ad84-1d7847d9e0bd tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:13.355202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a4995e54-04a8-45e0-ad84-1d7847d9e0bd tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:13.355646 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a4995e54-04a8-45e0-ad84-1d7847d9e0bd tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:13.356398 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a4995e54-04a8-45e0-ad84-1d7847d9e0bd tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:13.356864 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a4995e54-04a8-45e0-ad84-1d7847d9e0bd tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:13.385598 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-a4995e54-04a8-45e0-ad84-1d7847d9e0bd tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d/os-volume_attachments/8f40a1d9-e173-4194-ba08-7007c309d37c" status: 200 len: 194 microversion: 2.1 time: 0.042825 May 26 12:44:13.386164 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 552/1095] 10.222.0.39 () {58 vars in 1412 bytes} [Thu May 26 12:44:13 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d/os-volume_attachments/8f40a1d9-e173-4194-ba08-7007c309d37c => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:13.397364 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-512b1ab0-8c88-46e0-a522-ab83be660930 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:13.397977 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-512b1ab0-8c88-46e0-a522-ab83be660930 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:13.404505 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-512b1ab0-8c88-46e0-a522-ab83be660930 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:13.404989 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-512b1ab0-8c88-46e0-a522-ab83be660930 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:13.405757 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-512b1ab0-8c88-46e0-a522-ab83be660930 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:13.406197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-512b1ab0-8c88-46e0-a522-ab83be660930 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:13.488244 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.objects.instance [None req-512b1ab0-8c88-46e0-a522-ab83be660930 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lazy-loading 'services' on Instance uuid 411d94dd-76cb-418b-bfac-d1948a57f92d {{(pid=124133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:44:13.559866 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-512b1ab0-8c88-46e0-a522-ab83be660930 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "DELETE /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d/os-volume_attachments/8f40a1d9-e173-4194-ba08-7007c309d37c" status: 202 len: 0 microversion: 2.1 time: 0.167503 May 26 12:44:13.560465 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 544/1096] 10.222.0.39 () {58 vars in 1415 bytes} [Thu May 26 12:44:13 2022] DELETE /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d/os-volume_attachments/8f40a1d9-e173-4194-ba08-7007c309d37c => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:44:20.296301 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-4bf0a55a-f6cc-4a07-abca-acfc9d7529bd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:20.296860 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-4bf0a55a-f6cc-4a07-abca-acfc9d7529bd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:20.303416 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4bf0a55a-f6cc-4a07-abca-acfc9d7529bd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:20.303871 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4bf0a55a-f6cc-4a07-abca-acfc9d7529bd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:20.304648 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4bf0a55a-f6cc-4a07-abca-acfc9d7529bd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:20.305128 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-4bf0a55a-f6cc-4a07-abca-acfc9d7529bd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:20.388213 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.objects.instance [None req-4bf0a55a-f6cc-4a07-abca-acfc9d7529bd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lazy-loading 'services' on Instance uuid 6569d326-c20a-4044-89b6-db08739f36f6 {{(pid=124134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:44:20.461388 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-4bf0a55a-f6cc-4a07-abca-acfc9d7529bd tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6/os-volume_attachments/eccd69f2-6196-4689-ab3f-299fd2b060a2" status: 202 len: 0 microversion: 2.1 time: 0.169382 May 26 12:44:20.462293 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 553/1097] 10.222.0.39 () {58 vars in 1415 bytes} [Thu May 26 12:44:20 2022] DELETE /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6/os-volume_attachments/eccd69f2-6196-4689-ab3f-299fd2b060a2 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:44:20.474706 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-54f71939-4de5-4cb6-b048-b7368604eec9 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:20.476325 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-54f71939-4de5-4cb6-b048-b7368604eec9 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:20.486965 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-54f71939-4de5-4cb6-b048-b7368604eec9 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:20.487645 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-54f71939-4de5-4cb6-b048-b7368604eec9 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:20.488745 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-54f71939-4de5-4cb6-b048-b7368604eec9 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:20.489482 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-54f71939-4de5-4cb6-b048-b7368604eec9 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:20.528564 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-54f71939-4de5-4cb6-b048-b7368604eec9 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058822 May 26 12:44:20.529257 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 545/1098] 10.222.0.39 () {58 vars in 1301 bytes} [Thu May 26 12:44:20 2022] GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:44:21.060160 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-2367d064-cecf-4451-8cb3-d9881da86922 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:21.061279 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-2367d064-cecf-4451-8cb3-d9881da86922 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:21.067733 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2367d064-cecf-4451-8cb3-d9881da86922 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:21.068194 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2367d064-cecf-4451-8cb3-d9881da86922 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:21.069004 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2367d064-cecf-4451-8cb3-d9881da86922 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:21.069450 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2367d064-cecf-4451-8cb3-d9881da86922 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:21.100392 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-2367d064-cecf-4451-8cb3-d9881da86922 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044813 May 26 12:44:21.101108 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 554/1099] 10.222.0.39 () {58 vars in 1301 bytes} [Thu May 26 12:44:21 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:44:21.218676 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-c7e3cc31-5156-48a0-8898-2259dd19d23c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:21.219643 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-c7e3cc31-5156-48a0-8898-2259dd19d23c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:21.226145 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c7e3cc31-5156-48a0-8898-2259dd19d23c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:21.226596 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c7e3cc31-5156-48a0-8898-2259dd19d23c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:21.227402 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c7e3cc31-5156-48a0-8898-2259dd19d23c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:21.228454 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c7e3cc31-5156-48a0-8898-2259dd19d23c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:21.256617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-c7e3cc31-5156-48a0-8898-2259dd19d23c tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041930 May 26 12:44:21.257210 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 546/1100] 10.222.0.39 () {58 vars in 1301 bytes} [Thu May 26 12:44:21 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:44:21.316162 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-ab20b751-b721-4913-977e-228631ce6d93 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:21.316667 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-ab20b751-b721-4913-977e-228631ce6d93 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:21.324043 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ab20b751-b721-4913-977e-228631ce6d93 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:21.324504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ab20b751-b721-4913-977e-228631ce6d93 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:21.325304 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ab20b751-b721-4913-977e-228631ce6d93 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:21.325752 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ab20b751-b721-4913-977e-228631ce6d93 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:21.360667 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-ab20b751-b721-4913-977e-228631ce6d93 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Going to try to terminate instance {{(pid=124134) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:44:21.450344 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-ab20b751-b721-4913-977e-228631ce6d93 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "DELETE /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d" status: 204 len: 0 microversion: 2.1 time: 0.137121 May 26 12:44:21.451158 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 555/1101] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:44:21 2022] DELETE /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:44:21.460448 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ad432b20-775e-49ff-b92f-2e2acceabb17 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:21.461098 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ad432b20-775e-49ff-b92f-2e2acceabb17 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:21.468236 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ad432b20-775e-49ff-b92f-2e2acceabb17 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:21.469073 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ad432b20-775e-49ff-b92f-2e2acceabb17 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:21.470010 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ad432b20-775e-49ff-b92f-2e2acceabb17 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:21.470459 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ad432b20-775e-49ff-b92f-2e2acceabb17 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:21.541264 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-8821c28c-aae1-4612-8f5b-c66be8dc7916 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:21.542298 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-8821c28c-aae1-4612-8f5b-c66be8dc7916 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:21.548810 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8821c28c-aae1-4612-8f5b-c66be8dc7916 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:21.549276 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8821c28c-aae1-4612-8f5b-c66be8dc7916 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:21.550047 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8821c28c-aae1-4612-8f5b-c66be8dc7916 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:21.550669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8821c28c-aae1-4612-8f5b-c66be8dc7916 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:21.586202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-8821c28c-aae1-4612-8f5b-c66be8dc7916 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050374 May 26 12:44:21.586778 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 556/1102] 10.222.0.39 () {58 vars in 1301 bytes} [Thu May 26 12:44:21 2022] GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 12:44:21.619474 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ad432b20-775e-49ff-b92f-2e2acceabb17 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:21.630195 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ad432b20-775e-49ff-b92f-2e2acceabb17 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d" status: 200 len: 1674 microversion: 2.1 time: 0.174251 May 26 12:44:21.631157 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 547/1103] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:21 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:21.653689 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-733ed60a-0108-4572-9701-c313e7e19960 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:21.654190 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-733ed60a-0108-4572-9701-c313e7e19960 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:21.660201 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-733ed60a-0108-4572-9701-c313e7e19960 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:21.660646 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-733ed60a-0108-4572-9701-c313e7e19960 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:21.661446 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-733ed60a-0108-4572-9701-c313e7e19960 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:21.661890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-733ed60a-0108-4572-9701-c313e7e19960 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:21.687069 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-733ed60a-0108-4572-9701-c313e7e19960 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Going to try to terminate instance {{(pid=124134) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:44:21.766572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-733ed60a-0108-4572-9701-c313e7e19960 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6" status: 204 len: 0 microversion: 2.1 time: 0.116461 May 26 12:44:21.767089 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 557/1104] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:44:21 2022] DELETE /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:44:21.776195 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ad55bde8-2118-4635-96ad-706cda81ef7b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:21.776844 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ad55bde8-2118-4635-96ad-706cda81ef7b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:21.782917 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ad55bde8-2118-4635-96ad-706cda81ef7b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:21.783371 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ad55bde8-2118-4635-96ad-706cda81ef7b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:21.784139 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ad55bde8-2118-4635-96ad-706cda81ef7b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:21.784584 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ad55bde8-2118-4635-96ad-706cda81ef7b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:21.918894 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ad55bde8-2118-4635-96ad-706cda81ef7b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:21.926403 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ad55bde8-2118-4635-96ad-706cda81ef7b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6" status: 200 len: 1682 microversion: 2.1 time: 0.154558 May 26 12:44:21.926962 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 548/1105] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:21 2022] GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:44:22.648950 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-d634e4bd-b3e5-45c5-8f9f-3d1e59fb0f37 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:22.650150 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-d634e4bd-b3e5-45c5-8f9f-3d1e59fb0f37 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:22.656770 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d634e4bd-b3e5-45c5-8f9f-3d1e59fb0f37 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:22.657223 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d634e4bd-b3e5-45c5-8f9f-3d1e59fb0f37 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:22.657989 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d634e4bd-b3e5-45c5-8f9f-3d1e59fb0f37 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:22.658430 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d634e4bd-b3e5-45c5-8f9f-3d1e59fb0f37 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:22.677034 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=5 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:22.800247 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d634e4bd-b3e5-45c5-8f9f-3d1e59fb0f37 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:22.808488 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-d634e4bd-b3e5-45c5-8f9f-3d1e59fb0f37 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d" status: 200 len: 1674 microversion: 2.1 time: 0.163849 May 26 12:44:22.809084 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 558/1106] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:22 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:22.949870 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-93183189-e7ab-485b-8ed7-2bc47d004243 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:22.950468 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-93183189-e7ab-485b-8ed7-2bc47d004243 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:22.952895 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=23 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:22.958124 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-93183189-e7ab-485b-8ed7-2bc47d004243 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:22.958578 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-93183189-e7ab-485b-8ed7-2bc47d004243 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:22.959360 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-93183189-e7ab-485b-8ed7-2bc47d004243 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:22.959782 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-93183189-e7ab-485b-8ed7-2bc47d004243 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:22.963400 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:23.098555 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-93183189-e7ab-485b-8ed7-2bc47d004243 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:23.106329 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-93183189-e7ab-485b-8ed7-2bc47d004243 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6" status: 200 len: 1682 microversion: 2.1 time: 0.161001 May 26 12:44:23.106895 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 549/1107] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:22 2022] GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:23.828625 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f41e566d-b6ea-4af9-a006-bf758477e9b5 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:23.829281 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-f41e566d-b6ea-4af9-a006-bf758477e9b5 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:23.835804 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f41e566d-b6ea-4af9-a006-bf758477e9b5 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:23.836257 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f41e566d-b6ea-4af9-a006-bf758477e9b5 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:23.837646 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f41e566d-b6ea-4af9-a006-bf758477e9b5 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:23.838155 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f41e566d-b6ea-4af9-a006-bf758477e9b5 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:23.966742 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-f41e566d-b6ea-4af9-a006-bf758477e9b5 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:23.974294 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-f41e566d-b6ea-4af9-a006-bf758477e9b5 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d" status: 200 len: 1674 microversion: 2.1 time: 0.149647 May 26 12:44:23.974857 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 559/1108] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:23 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:24.123986 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-aa6fe18a-3753-4ef7-837e-48dccc0a2dce tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:24.124558 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-aa6fe18a-3753-4ef7-837e-48dccc0a2dce tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:24.131037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-aa6fe18a-3753-4ef7-837e-48dccc0a2dce tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:24.131483 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-aa6fe18a-3753-4ef7-837e-48dccc0a2dce tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:24.132237 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-aa6fe18a-3753-4ef7-837e-48dccc0a2dce tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:24.132669 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-aa6fe18a-3753-4ef7-837e-48dccc0a2dce tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:24.268818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-aa6fe18a-3753-4ef7-837e-48dccc0a2dce tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:24.276563 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-aa6fe18a-3753-4ef7-837e-48dccc0a2dce tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6" status: 200 len: 1682 microversion: 2.1 time: 0.156519 May 26 12:44:24.277186 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 550/1109] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:24 2022] GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:24.991440 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-9efdfad5-bba7-4fb7-818b-266358da76ad tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:24.992034 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-9efdfad5-bba7-4fb7-818b-266358da76ad tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:24.994985 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:25.000463 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9efdfad5-bba7-4fb7-818b-266358da76ad tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:25.000941 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9efdfad5-bba7-4fb7-818b-266358da76ad tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:25.001699 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9efdfad5-bba7-4fb7-818b-266358da76ad tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:25.002143 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9efdfad5-bba7-4fb7-818b-266358da76ad tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:25.145902 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-9efdfad5-bba7-4fb7-818b-266358da76ad tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:25.154118 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-9efdfad5-bba7-4fb7-818b-266358da76ad tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d" status: 200 len: 1674 microversion: 2.1 time: 0.166442 May 26 12:44:25.164213 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 560/1110] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:24 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d => generated 1674 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:25.296345 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-29b31993-f232-4fe1-97ea-8dda50a6edb4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:25.297819 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-29b31993-f232-4fe1-97ea-8dda50a6edb4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:25.307643 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-29b31993-f232-4fe1-97ea-8dda50a6edb4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:25.308396 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-29b31993-f232-4fe1-97ea-8dda50a6edb4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:25.309444 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-29b31993-f232-4fe1-97ea-8dda50a6edb4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:25.310191 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-29b31993-f232-4fe1-97ea-8dda50a6edb4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:25.554950 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-29b31993-f232-4fe1-97ea-8dda50a6edb4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:25.564207 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-29b31993-f232-4fe1-97ea-8dda50a6edb4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6" status: 200 len: 1682 microversion: 2.1 time: 0.273144 May 26 12:44:25.575451 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 551/1111] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:25 2022] GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6 => generated 1682 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:44:26.176126 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-b36269be-77a7-405d-a08e-c6b288687038 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:26.189699 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-b36269be-77a7-405d-a08e-c6b288687038 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:26.220408 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b36269be-77a7-405d-a08e-c6b288687038 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:26.225011 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b36269be-77a7-405d-a08e-c6b288687038 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:26.230489 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b36269be-77a7-405d-a08e-c6b288687038 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:26.235410 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b36269be-77a7-405d-a08e-c6b288687038 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:26.663239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-5e33b86a-0001-49d7-8439-3ab54be421c7 req-3348edfe-861a-4e56-91fc-0403ecc0ec13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "411d94dd-76cb-418b-bfac-d1948a57f92d", "name": "network-vif-deleted", "tag": "b10bc25c-5ab6-4524-8866-5be0a8a8aad6"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:44:26.678266 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-5e33b86a-0001-49d7-8439-3ab54be421c7 req-3348edfe-861a-4e56-91fc-0403ecc0ec13 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:26.679415 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-5e33b86a-0001-49d7-8439-3ab54be421c7 req-3348edfe-861a-4e56-91fc-0403ecc0ec13 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:26.703188 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-5e33b86a-0001-49d7-8439-3ab54be421c7 req-3348edfe-861a-4e56-91fc-0403ecc0ec13 service nova] Creating event network-vif-deleted:b10bc25c-5ab6-4524-8866-5be0a8a8aad6 for instance 411d94dd-76cb-418b-bfac-d1948a57f92d on hv-cinder-81514 May 26 12:44:26.713279 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-5e33b86a-0001-49d7-8439-3ab54be421c7 req-3348edfe-861a-4e56-91fc-0403ecc0ec13 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.613789 May 26 12:44:26.715324 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 561/1112] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:26.727915 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-ad7403ed-4564-489c-9842-7048fccef89a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:26.729918 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-ad7403ed-4564-489c-9842-7048fccef89a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:26.742099 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ad7403ed-4564-489c-9842-7048fccef89a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:26.743153 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ad7403ed-4564-489c-9842-7048fccef89a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:26.744645 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ad7403ed-4564-489c-9842-7048fccef89a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:26.745599 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ad7403ed-4564-489c-9842-7048fccef89a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:26.783536 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-b36269be-77a7-405d-a08e-c6b288687038 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1156b006d6e1426a84a521d397491135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079362a77e344c61af67f7b256545329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:26.796355 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-b36269be-77a7-405d-a08e-c6b288687038 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d" status: 200 len: 1322 microversion: 2.1 time: 0.628181 May 26 12:44:26.812575 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 552/1113] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:26 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d => generated 1322 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:26.844079 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-8bee36bc-f429-415a-a59b-0da3f8c12565 req-4b82b398-c9ce-4ac5-a9b8-4cee13869620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6569d326-c20a-4044-89b6-db08739f36f6", "name": "network-vif-deleted", "tag": "a9732a91-5268-4fd5-8f72-233936555083"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:44:26.869893 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-8bee36bc-f429-415a-a59b-0da3f8c12565 req-4b82b398-c9ce-4ac5-a9b8-4cee13869620 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:26.872954 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-8bee36bc-f429-415a-a59b-0da3f8c12565 req-4b82b398-c9ce-4ac5-a9b8-4cee13869620 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:26.877691 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ad7403ed-4564-489c-9842-7048fccef89a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b14606965a74c71881595c71bdd2d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef656c0ca2943eb965bf10d4e943d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:26.887540 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-ad7403ed-4564-489c-9842-7048fccef89a tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6" status: 200 len: 1615 microversion: 2.1 time: 0.168600 May 26 12:44:26.888362 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 562/1114] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:26 2022] GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6 => generated 1615 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:26.903254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-8bee36bc-f429-415a-a59b-0da3f8c12565 req-4b82b398-c9ce-4ac5-a9b8-4cee13869620 service nova] Creating event network-vif-deleted:a9732a91-5268-4fd5-8f72-233936555083 for instance 6569d326-c20a-4044-89b6-db08739f36f6 on hv-cinder-81514 May 26 12:44:26.925368 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-8bee36bc-f429-415a-a59b-0da3f8c12565 req-4b82b398-c9ce-4ac5-a9b8-4cee13869620 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082944 May 26 12:44:26.929609 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 553/1115] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:27.816818 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-8646d1c1-997d-4414-9350-351c8163c6ff tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:27.817522 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-8646d1c1-997d-4414-9350-351c8163c6ff tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:27.825746 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8646d1c1-997d-4414-9350-351c8163c6ff tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:27.826202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8646d1c1-997d-4414-9350-351c8163c6ff tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:27.827022 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8646d1c1-997d-4414-9350-351c8163c6ff tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:27.827461 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8646d1c1-997d-4414-9350-351c8163c6ff tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:27.843137 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.wsgi [None req-8646d1c1-997d-4414-9350-351c8163c6ff tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] HTTP exception thrown: Instance 411d94dd-76cb-418b-bfac-d1948a57f92d could not be found. May 26 12:44:27.845101 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-8646d1c1-997d-4414-9350-351c8163c6ff tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Request method failure captured: May 26 12:44:27.845101 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: request: GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d HTTP/1.1 May 26 12:44:27.845101 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept: application/json May 26 12:44:27.845101 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept-Encoding: identity May 26 12:44:27.845101 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Connection: close May 26 12:44:27.845101 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Length: 0 May 26 12:44:27.845101 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Type: application/json May 26 12:44:27.845101 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Host: 10.222.0.39 May 26 12:44:27.845101 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Openstack-System-Scope: None May 26 12:44:27.845101 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: User-Agent: python-urllib3/1.26.9 May 26 12:44:27.845101 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Auth-Token: gAAAAABij3Pu-saym90ZugmL3MHfzkh3-IPtVZXgzoR3exsnu8n8HoKOTtd8zpUAVsLjhxBU3j_zoT72IpEaxwJiXS--zqSas-twRwX9KEZXcZudPVAXGqSRSYJW1jsHAcB8R-kToK2lzxh_xwqg51Jpvzf-AAGhDWT6Uu6U-Dd3iI5K6i0lhdY May 26 12:44:27.845101 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Id: None May 26 12:44:27.845101 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Name: None May 26 12:44:27.845101 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Identity-Status: Confirmed May 26 12:44:27.845101 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Is-Admin-Project: True May 26 12:44:27.845101 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Id: default May 26 12:44:27.845101 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Name: Default May 26 12:44:27.845101 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Id: 079362a77e344c61af67f7b256545329 May 26 12:44:27.845101 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Name: tempest-AttachVolumeTestJSON-1419980377 May 26 12:44:27.845101 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Role: member,reader May 26 12:44:27.845101 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Roles: member,reader May 26 12:44:27.846761 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/079362a77e344c61af67f7b256545329"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_079362a77e344c61af67f7b256545329", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/079362a77e344c61af67f7b256545329"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/079362a77e344c61af67f7b256545329"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:44:27.846761 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant: tempest-AttachVolumeTestJSON-1419980377 May 26 12:44:27.846761 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Id: 079362a77e344c61af67f7b256545329 May 26 12:44:27.846761 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1419980377 May 26 12:44:27.846761 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User: tempest-AttachVolumeTestJSON-1419980377-project May 26 12:44:27.846761 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Id: default May 26 12:44:27.846761 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Name: Default May 26 12:44:27.846761 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Id: 1156b006d6e1426a84a521d397491135 May 26 12:44:27.846761 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Name: tempest-AttachVolumeTestJSON-1419980377-project May 26 12:44:27.846761 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: method: > May 26 12:44:27.846761 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: exception: Instance 411d94dd-76cb-418b-bfac-d1948a57f92d could not be found. May 26 12:44:27.846761 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: action_args: {'id': '411d94dd-76cb-418b-bfac-d1948a57f92d'} May 26 12:44:27.847720 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:44:27.847720 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:27.847720 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:44:27.847720 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:44:27.847720 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:44:27.847720 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:44:27.847720 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:44:27.847720 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:44:27.847720 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:44:27.847720 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:44:27.847720 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 411d94dd-76cb-418b-bfac-d1948a57f92d could not be found. May 26 12:44:27.847720 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:27.847720 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:27.847720 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:27.847720 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:27.847720 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:27.847720 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:27.847720 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:44:27.847720 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:44:27.847720 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:44:27.849372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:44:27.849372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:44:27.849372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:44:27.849372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:44:27.849372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:44:27.849372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:44:27.849372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:44:27.849372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 411d94dd-76cb-418b-bfac-d1948a57f92d could not be found. May 26 12:44:27.849372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:27.849372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:27.849372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:27.849372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:27.849372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:27.849372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:27.849372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:44:27.849372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:44:27.849372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 411d94dd-76cb-418b-bfac-d1948a57f92d could not be found. May 26 12:44:27.849372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:27.851153 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-8646d1c1-997d-4414-9350-351c8163c6ff tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Returning 404 to user: Instance 411d94dd-76cb-418b-bfac-d1948a57f92d could not be found. {{(pid=124134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:44:27.851153 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-8646d1c1-997d-4414-9350-351c8163c6ff tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d" status: 404 len: 111 microversion: 2.1 time: 0.035251 May 26 12:44:27.851153 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 563/1116] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:27 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:44:27.857571 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-eb34c55d-762d-4812-ab27-3a50fdf1fa7f tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '.version_select at 0x7fed327ead30>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:27.874622 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-eb34c55d-762d-4812-ab27-3a50fdf1fa7f tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-852620833" status: 202 len: 0 microversion: 2.1 time: 0.022455 May 26 12:44:27.875201 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 554/1117] 10.222.0.39 () {58 vars in 1217 bytes} [Thu May 26 12:44:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-852620833 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:44:27.905474 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-48735339-9d1b-4847-afea-a838058ca7de tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:27.906101 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-48735339-9d1b-4847-afea-a838058ca7de tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:27.912242 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-48735339-9d1b-4847-afea-a838058ca7de tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:27.912692 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-48735339-9d1b-4847-afea-a838058ca7de tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:27.913493 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-48735339-9d1b-4847-afea-a838058ca7de tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:27.913930 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-48735339-9d1b-4847-afea-a838058ca7de tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:27.928442 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.wsgi [None req-48735339-9d1b-4847-afea-a838058ca7de tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] HTTP exception thrown: Instance 6569d326-c20a-4044-89b6-db08739f36f6 could not be found. May 26 12:44:27.930012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-48735339-9d1b-4847-afea-a838058ca7de tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Request method failure captured: May 26 12:44:27.930012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: request: GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6 HTTP/1.1 May 26 12:44:27.930012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept: application/json May 26 12:44:27.930012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept-Encoding: identity May 26 12:44:27.930012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Connection: close May 26 12:44:27.930012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Length: 0 May 26 12:44:27.930012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Type: application/json May 26 12:44:27.930012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Host: 10.222.0.39 May 26 12:44:27.930012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Openstack-System-Scope: None May 26 12:44:27.930012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: User-Agent: python-urllib3/1.26.9 May 26 12:44:27.930012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Auth-Token: gAAAAABij3NlvcGUyXKMcR3f44eTcb9KUX9Z1HAOP6nfmLvSlYo0JIjkhlxQnvnKs5YzuXlFyVI90MMwVyxF6G0XRw3coPQTRjw_l752cMl_otjGJnnaQ4RjUOg-dE0XHNrSgowu0nH-j9SReMVUJ7YwVfxzPS5nbVTF1HJ2aVri9hxI7XdrhVs May 26 12:44:27.930012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Id: None May 26 12:44:27.930012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Name: None May 26 12:44:27.930012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Identity-Status: Confirmed May 26 12:44:27.930012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Is-Admin-Project: True May 26 12:44:27.930012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Id: default May 26 12:44:27.930012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Name: Default May 26 12:44:27.930012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:44:27.930012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:44:27.930012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Role: member,reader May 26 12:44:27.930012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Roles: member,reader May 26 12:44:27.931522 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7ef656c0ca2943eb965bf10d4e943d27", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:44:27.931522 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:44:27.931522 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:44:27.931522 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:44:27.931522 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:44:27.931522 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Id: default May 26 12:44:27.931522 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Name: Default May 26 12:44:27.931522 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Id: 7b14606965a74c71881595c71bdd2d58 May 26 12:44:27.931522 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Name: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:44:27.931522 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: method: > May 26 12:44:27.931522 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: exception: Instance 6569d326-c20a-4044-89b6-db08739f36f6 could not be found. May 26 12:44:27.931522 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: action_args: {'id': '6569d326-c20a-4044-89b6-db08739f36f6'} May 26 12:44:27.932288 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:44:27.932288 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:27.932288 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:44:27.932288 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:44:27.932288 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:44:27.932288 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:44:27.932288 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:44:27.932288 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:44:27.932288 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:44:27.932288 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:44:27.932288 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6569d326-c20a-4044-89b6-db08739f36f6 could not be found. May 26 12:44:27.932288 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:27.932288 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:27.932288 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:27.932288 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:27.932288 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:27.932288 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:27.932288 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:44:27.932288 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:44:27.932288 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:44:27.933621 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:44:27.933621 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:44:27.933621 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:44:27.933621 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:44:27.933621 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:44:27.933621 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:44:27.933621 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:44:27.933621 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6569d326-c20a-4044-89b6-db08739f36f6 could not be found. May 26 12:44:27.933621 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:27.933621 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:27.933621 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:27.933621 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:27.933621 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:27.933621 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:27.933621 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:44:27.933621 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:44:27.933621 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6569d326-c20a-4044-89b6-db08739f36f6 could not be found. May 26 12:44:27.933621 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:27.934715 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-48735339-9d1b-4847-afea-a838058ca7de tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Returning 404 to user: Instance 6569d326-c20a-4044-89b6-db08739f36f6 could not be found. {{(pid=124134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:44:27.934715 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-48735339-9d1b-4847-afea-a838058ca7de tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6" status: 404 len: 111 microversion: 2.1 time: 0.029967 May 26 12:44:27.934715 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 564/1118] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:27 2022] GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:44:27.944315 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-77afcb08-6e50-42f8-8701-072fa82a2aec tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '.version_select at 0x7fed31595700>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:27.964312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-77afcb08-6e50-42f8-8701-072fa82a2aec tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1147267048" status: 202 len: 0 microversion: 2.1 time: 0.024469 May 26 12:44:27.964933 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 555/1119] 10.222.0.39 () {58 vars in 1220 bytes} [Thu May 26 12:44:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1147267048 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:44:29.769702 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6ada2761-ec27-4227-95ea-d8099c288945 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:29.770228 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-6ada2761-ec27-4227-95ea-d8099c288945 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:29.777158 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6ada2761-ec27-4227-95ea-d8099c288945 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:29.777613 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6ada2761-ec27-4227-95ea-d8099c288945 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:29.779527 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6ada2761-ec27-4227-95ea-d8099c288945 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:29.779527 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6ada2761-ec27-4227-95ea-d8099c288945 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:29.797974 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.wsgi [None req-6ada2761-ec27-4227-95ea-d8099c288945 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] HTTP exception thrown: Instance 6569d326-c20a-4044-89b6-db08739f36f6 could not be found. May 26 12:44:29.799507 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6ada2761-ec27-4227-95ea-d8099c288945 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Request method failure captured: May 26 12:44:29.799507 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: request: DELETE /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6 HTTP/1.1 May 26 12:44:29.799507 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept: application/json May 26 12:44:29.799507 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept-Encoding: identity May 26 12:44:29.799507 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Connection: close May 26 12:44:29.799507 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Length: 0 May 26 12:44:29.799507 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Type: application/json May 26 12:44:29.799507 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Host: 10.222.0.39 May 26 12:44:29.799507 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Openstack-System-Scope: None May 26 12:44:29.799507 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: User-Agent: python-urllib3/1.26.9 May 26 12:44:29.799507 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Auth-Token: gAAAAABij3NlvcGUyXKMcR3f44eTcb9KUX9Z1HAOP6nfmLvSlYo0JIjkhlxQnvnKs5YzuXlFyVI90MMwVyxF6G0XRw3coPQTRjw_l752cMl_otjGJnnaQ4RjUOg-dE0XHNrSgowu0nH-j9SReMVUJ7YwVfxzPS5nbVTF1HJ2aVri9hxI7XdrhVs May 26 12:44:29.799507 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Id: None May 26 12:44:29.799507 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Name: None May 26 12:44:29.799507 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Identity-Status: Confirmed May 26 12:44:29.799507 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Is-Admin-Project: True May 26 12:44:29.799507 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Id: default May 26 12:44:29.799507 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Name: Default May 26 12:44:29.799507 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:44:29.799507 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:44:29.799507 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Role: member,reader May 26 12:44:29.799507 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Roles: member,reader May 26 12:44:29.801166 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7ef656c0ca2943eb965bf10d4e943d27", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:44:29.801166 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:44:29.801166 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:44:29.801166 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:44:29.801166 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:44:29.801166 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Id: default May 26 12:44:29.801166 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Name: Default May 26 12:44:29.801166 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Id: 7b14606965a74c71881595c71bdd2d58 May 26 12:44:29.801166 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Name: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:44:29.801166 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: method: > May 26 12:44:29.801166 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: exception: Instance 6569d326-c20a-4044-89b6-db08739f36f6 could not be found. May 26 12:44:29.801166 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: action_args: {'id': '6569d326-c20a-4044-89b6-db08739f36f6'} May 26 12:44:29.805001 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:44:29.805001 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:29.805001 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:44:29.805001 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:44:29.805001 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:44:29.805001 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:44:29.805001 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:44:29.805001 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:44:29.805001 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:44:29.805001 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:44:29.805001 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6569d326-c20a-4044-89b6-db08739f36f6 could not be found. May 26 12:44:29.805001 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:29.805001 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:29.805001 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:29.805001 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:29.805001 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:29.805001 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:29.805001 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:44:29.805001 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:44:29.805001 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:44:29.806791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:44:29.806791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:44:29.806791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:44:29.806791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:44:29.806791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:44:29.806791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:44:29.806791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:44:29.806791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:44:29.806791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:44:29.806791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6569d326-c20a-4044-89b6-db08739f36f6 could not be found. May 26 12:44:29.806791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:29.806791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:29.806791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:29.806791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:29.806791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:29.806791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:29.806791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:44:29.806791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:44:29.806791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6569d326-c20a-4044-89b6-db08739f36f6 could not be found. May 26 12:44:29.806791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:29.808360 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6ada2761-ec27-4227-95ea-d8099c288945 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Returning 404 to user: Instance 6569d326-c20a-4044-89b6-db08739f36f6 could not be found. {{(pid=124134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:44:29.808360 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-6ada2761-ec27-4227-95ea-d8099c288945 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6" status: 404 len: 111 microversion: 2.1 time: 0.035428 May 26 12:44:29.808360 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 565/1120] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:44:29 2022] DELETE /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:44:29.809375 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d25be395-a850-49e8-a303-14f9d4aa4d9b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:29.810108 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d25be395-a850-49e8-a303-14f9d4aa4d9b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 6569d326-c20a-4044-89b6-db08739f36f6] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:29.816743 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d25be395-a850-49e8-a303-14f9d4aa4d9b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:29.817197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d25be395-a850-49e8-a303-14f9d4aa4d9b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:29.817952 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d25be395-a850-49e8-a303-14f9d4aa4d9b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:29.818390 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d25be395-a850-49e8-a303-14f9d4aa4d9b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:29.831810 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-d25be395-a850-49e8-a303-14f9d4aa4d9b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] HTTP exception thrown: Instance 6569d326-c20a-4044-89b6-db08739f36f6 could not be found. May 26 12:44:29.833419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d25be395-a850-49e8-a303-14f9d4aa4d9b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Request method failure captured: May 26 12:44:29.833419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6 HTTP/1.1 May 26 12:44:29.833419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:44:29.833419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:44:29.833419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:44:29.833419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:44:29.833419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:44:29.833419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:44:29.833419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:44:29.833419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:44:29.833419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3NlvcGUyXKMcR3f44eTcb9KUX9Z1HAOP6nfmLvSlYo0JIjkhlxQnvnKs5YzuXlFyVI90MMwVyxF6G0XRw3coPQTRjw_l752cMl_otjGJnnaQ4RjUOg-dE0XHNrSgowu0nH-j9SReMVUJ7YwVfxzPS5nbVTF1HJ2aVri9hxI7XdrhVs May 26 12:44:29.833419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:44:29.833419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:44:29.833419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:44:29.833419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:44:29.833419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:44:29.833419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:44:29.833419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:44:29.833419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:44:29.833419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:44:29.833419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:44:29.834942 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7ef656c0ca2943eb965bf10d4e943d27", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:44:29.834942 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:44:29.834942 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:44:29.834942 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:44:29.834942 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:44:29.834942 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:44:29.834942 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:44:29.834942 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: 7b14606965a74c71881595c71bdd2d58 May 26 12:44:29.834942 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:44:29.834942 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: > May 26 12:44:29.834942 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Instance 6569d326-c20a-4044-89b6-db08739f36f6 could not be found. May 26 12:44:29.834942 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': '6569d326-c20a-4044-89b6-db08739f36f6'} May 26 12:44:29.835829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:44:29.835829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:29.835829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:44:29.835829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:44:29.835829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:44:29.835829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:44:29.835829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:44:29.835829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:44:29.835829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:44:29.835829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:44:29.835829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6569d326-c20a-4044-89b6-db08739f36f6 could not be found. May 26 12:44:29.835829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:29.835829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:29.835829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:29.835829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:29.835829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:29.835829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:29.835829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:44:29.835829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:44:29.835829 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:44:29.838083 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:44:29.838083 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:44:29.838083 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:44:29.838083 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:44:29.838083 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:44:29.838083 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:44:29.838083 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:44:29.838083 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6569d326-c20a-4044-89b6-db08739f36f6 could not be found. May 26 12:44:29.838083 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:29.838083 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:29.838083 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:29.838083 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:29.838083 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:29.838083 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:29.838083 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:44:29.838083 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:44:29.838083 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6569d326-c20a-4044-89b6-db08739f36f6 could not be found. May 26 12:44:29.838083 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:29.839434 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d25be395-a850-49e8-a303-14f9d4aa4d9b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Returning 404 to user: Instance 6569d326-c20a-4044-89b6-db08739f36f6 could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:44:29.839434 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-d25be395-a850-49e8-a303-14f9d4aa4d9b tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6" status: 404 len: 111 microversion: 2.1 time: 0.029251 May 26 12:44:29.839434 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 556/1121] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:29 2022] GET /compute/v2.1/servers/6569d326-c20a-4044-89b6-db08739f36f6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:44:30.817716 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e2d5a545-b618-46a5-a537-6519609feb0a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:30.818205 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-e2d5a545-b618-46a5-a537-6519609feb0a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:30.824702 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e2d5a545-b618-46a5-a537-6519609feb0a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:30.825173 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e2d5a545-b618-46a5-a537-6519609feb0a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:30.825921 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e2d5a545-b618-46a5-a537-6519609feb0a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:30.826352 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e2d5a545-b618-46a5-a537-6519609feb0a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:30.840099 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.wsgi [None req-e2d5a545-b618-46a5-a537-6519609feb0a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] HTTP exception thrown: Instance 411d94dd-76cb-418b-bfac-d1948a57f92d could not be found. May 26 12:44:30.841572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e2d5a545-b618-46a5-a537-6519609feb0a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Request method failure captured: May 26 12:44:30.841572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: request: DELETE /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d HTTP/1.1 May 26 12:44:30.841572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept: application/json May 26 12:44:30.841572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept-Encoding: identity May 26 12:44:30.841572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Connection: close May 26 12:44:30.841572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Length: 0 May 26 12:44:30.841572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Type: application/json May 26 12:44:30.841572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Host: 10.222.0.39 May 26 12:44:30.841572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Openstack-System-Scope: None May 26 12:44:30.841572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: User-Agent: python-urllib3/1.26.9 May 26 12:44:30.841572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Auth-Token: gAAAAABij3Pu-saym90ZugmL3MHfzkh3-IPtVZXgzoR3exsnu8n8HoKOTtd8zpUAVsLjhxBU3j_zoT72IpEaxwJiXS--zqSas-twRwX9KEZXcZudPVAXGqSRSYJW1jsHAcB8R-kToK2lzxh_xwqg51Jpvzf-AAGhDWT6Uu6U-Dd3iI5K6i0lhdY May 26 12:44:30.841572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Id: None May 26 12:44:30.841572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Name: None May 26 12:44:30.841572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Identity-Status: Confirmed May 26 12:44:30.841572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Is-Admin-Project: True May 26 12:44:30.841572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Id: default May 26 12:44:30.841572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Name: Default May 26 12:44:30.841572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Id: 079362a77e344c61af67f7b256545329 May 26 12:44:30.841572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Name: tempest-AttachVolumeTestJSON-1419980377 May 26 12:44:30.841572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Role: member,reader May 26 12:44:30.841572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Roles: member,reader May 26 12:44:30.843165 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/079362a77e344c61af67f7b256545329"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_079362a77e344c61af67f7b256545329", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/079362a77e344c61af67f7b256545329"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/079362a77e344c61af67f7b256545329"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:44:30.843165 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant: tempest-AttachVolumeTestJSON-1419980377 May 26 12:44:30.843165 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Id: 079362a77e344c61af67f7b256545329 May 26 12:44:30.843165 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1419980377 May 26 12:44:30.843165 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User: tempest-AttachVolumeTestJSON-1419980377-project May 26 12:44:30.843165 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Id: default May 26 12:44:30.843165 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Name: Default May 26 12:44:30.843165 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Id: 1156b006d6e1426a84a521d397491135 May 26 12:44:30.843165 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Name: tempest-AttachVolumeTestJSON-1419980377-project May 26 12:44:30.843165 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: method: > May 26 12:44:30.843165 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: exception: Instance 411d94dd-76cb-418b-bfac-d1948a57f92d could not be found. May 26 12:44:30.843165 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: action_args: {'id': '411d94dd-76cb-418b-bfac-d1948a57f92d'} May 26 12:44:30.844018 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:44:30.844018 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:30.844018 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:44:30.844018 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:44:30.844018 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:44:30.844018 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:44:30.844018 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:44:30.844018 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:44:30.844018 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:44:30.844018 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:44:30.844018 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 411d94dd-76cb-418b-bfac-d1948a57f92d could not be found. May 26 12:44:30.844018 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:30.844018 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:30.844018 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:30.844018 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:30.844018 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:30.844018 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:30.844018 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:44:30.844018 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:44:30.844018 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:44:30.845620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:44:30.845620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:44:30.845620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:44:30.845620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:44:30.845620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:44:30.845620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:44:30.845620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:44:30.845620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:44:30.845620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:44:30.845620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 411d94dd-76cb-418b-bfac-d1948a57f92d could not be found. May 26 12:44:30.845620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:30.845620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:30.845620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:30.845620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:30.845620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:30.845620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:30.845620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:44:30.845620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:44:30.845620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 411d94dd-76cb-418b-bfac-d1948a57f92d could not be found. May 26 12:44:30.845620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:30.847080 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e2d5a545-b618-46a5-a537-6519609feb0a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Returning 404 to user: Instance 411d94dd-76cb-418b-bfac-d1948a57f92d could not be found. {{(pid=124134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:44:30.847080 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-e2d5a545-b618-46a5-a537-6519609feb0a tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "DELETE /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d" status: 404 len: 111 microversion: 2.1 time: 0.029000 May 26 12:44:30.847080 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 566/1122] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:44:30 2022] DELETE /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:44:30.851197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-4501bb47-33e9-423c-8c9f-ea54e974fccb tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:30.851809 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-4501bb47-33e9-423c-8c9f-ea54e974fccb tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 411d94dd-76cb-418b-bfac-d1948a57f92d] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:30.858968 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4501bb47-33e9-423c-8c9f-ea54e974fccb tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:30.859433 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4501bb47-33e9-423c-8c9f-ea54e974fccb tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:30.860173 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4501bb47-33e9-423c-8c9f-ea54e974fccb tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:30.860612 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4501bb47-33e9-423c-8c9f-ea54e974fccb tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:30.873729 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-4501bb47-33e9-423c-8c9f-ea54e974fccb tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] HTTP exception thrown: Instance 411d94dd-76cb-418b-bfac-d1948a57f92d could not be found. May 26 12:44:30.875211 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-4501bb47-33e9-423c-8c9f-ea54e974fccb tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Request method failure captured: May 26 12:44:30.875211 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d HTTP/1.1 May 26 12:44:30.875211 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:44:30.875211 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:44:30.875211 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:44:30.875211 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:44:30.875211 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:44:30.875211 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:44:30.875211 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:44:30.875211 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:44:30.875211 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3Pu-saym90ZugmL3MHfzkh3-IPtVZXgzoR3exsnu8n8HoKOTtd8zpUAVsLjhxBU3j_zoT72IpEaxwJiXS--zqSas-twRwX9KEZXcZudPVAXGqSRSYJW1jsHAcB8R-kToK2lzxh_xwqg51Jpvzf-AAGhDWT6Uu6U-Dd3iI5K6i0lhdY May 26 12:44:30.875211 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:44:30.875211 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:44:30.875211 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:44:30.875211 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:44:30.875211 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:44:30.875211 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:44:30.875211 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: 079362a77e344c61af67f7b256545329 May 26 12:44:30.875211 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-AttachVolumeTestJSON-1419980377 May 26 12:44:30.875211 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:44:30.875211 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:44:30.876756 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/079362a77e344c61af67f7b256545329"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_079362a77e344c61af67f7b256545329", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/079362a77e344c61af67f7b256545329"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/079362a77e344c61af67f7b256545329"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:44:30.876756 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-AttachVolumeTestJSON-1419980377 May 26 12:44:30.876756 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: 079362a77e344c61af67f7b256545329 May 26 12:44:30.876756 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1419980377 May 26 12:44:30.876756 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-AttachVolumeTestJSON-1419980377-project May 26 12:44:30.876756 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:44:30.876756 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:44:30.876756 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: 1156b006d6e1426a84a521d397491135 May 26 12:44:30.876756 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-AttachVolumeTestJSON-1419980377-project May 26 12:44:30.876756 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: > May 26 12:44:30.876756 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Instance 411d94dd-76cb-418b-bfac-d1948a57f92d could not be found. May 26 12:44:30.876756 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': '411d94dd-76cb-418b-bfac-d1948a57f92d'} May 26 12:44:30.877666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:44:30.877666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:30.877666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:44:30.877666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:44:30.877666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:44:30.877666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:44:30.877666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:44:30.877666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:44:30.877666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:44:30.877666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:44:30.877666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 411d94dd-76cb-418b-bfac-d1948a57f92d could not be found. May 26 12:44:30.877666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:30.877666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:30.877666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:30.877666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:30.877666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:30.877666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:30.877666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:44:30.877666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:44:30.877666 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:44:30.878872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:44:30.878872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:44:30.878872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:44:30.878872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:44:30.878872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:44:30.878872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:44:30.878872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:44:30.878872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 411d94dd-76cb-418b-bfac-d1948a57f92d could not be found. May 26 12:44:30.878872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:30.878872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:30.878872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:30.878872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:30.878872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:30.878872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:30.878872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:44:30.878872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:44:30.878872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 411d94dd-76cb-418b-bfac-d1948a57f92d could not be found. May 26 12:44:30.878872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:30.880000 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-4501bb47-33e9-423c-8c9f-ea54e974fccb tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Returning 404 to user: Instance 411d94dd-76cb-418b-bfac-d1948a57f92d could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:44:30.880000 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-4501bb47-33e9-423c-8c9f-ea54e974fccb tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d" status: 404 len: 111 microversion: 2.1 time: 0.029219 May 26 12:44:30.880000 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 557/1123] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:30 2022] GET /compute/v2.1/servers/411d94dd-76cb-418b-bfac-d1948a57f92d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:44:31.184847 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-22de414f-a916-48ef-9128-33d9773ac071 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:31.185337 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-22de414f-a916-48ef-9128-33d9773ac071 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:31.191377 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-22de414f-a916-48ef-9128-33d9773ac071 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:31.191827 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-22de414f-a916-48ef-9128-33d9773ac071 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:31.192574 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-22de414f-a916-48ef-9128-33d9773ac071 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:31.193031 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-22de414f-a916-48ef-9128-33d9773ac071 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:31.206361 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.wsgi [None req-22de414f-a916-48ef-9128-33d9773ac071 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] HTTP exception thrown: Instance 0db35800-34bb-4fda-bbb9-971062a3b16f could not be found. May 26 12:44:31.207870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-22de414f-a916-48ef-9128-33d9773ac071 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Request method failure captured: May 26 12:44:31.207870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: request: DELETE /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f HTTP/1.1 May 26 12:44:31.207870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept: application/json May 26 12:44:31.207870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept-Encoding: identity May 26 12:44:31.207870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Connection: close May 26 12:44:31.207870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Length: 0 May 26 12:44:31.207870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Type: application/json May 26 12:44:31.207870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Host: 10.222.0.39 May 26 12:44:31.207870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Openstack-System-Scope: None May 26 12:44:31.207870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: User-Agent: python-urllib3/1.26.9 May 26 12:44:31.207870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Auth-Token: gAAAAABij3NlvcGUyXKMcR3f44eTcb9KUX9Z1HAOP6nfmLvSlYo0JIjkhlxQnvnKs5YzuXlFyVI90MMwVyxF6G0XRw3coPQTRjw_l752cMl_otjGJnnaQ4RjUOg-dE0XHNrSgowu0nH-j9SReMVUJ7YwVfxzPS5nbVTF1HJ2aVri9hxI7XdrhVs May 26 12:44:31.207870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Id: None May 26 12:44:31.207870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Name: None May 26 12:44:31.207870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Identity-Status: Confirmed May 26 12:44:31.207870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Is-Admin-Project: True May 26 12:44:31.207870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Id: default May 26 12:44:31.207870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Name: Default May 26 12:44:31.207870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:44:31.207870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:44:31.207870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Role: member,reader May 26 12:44:31.207870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Roles: member,reader May 26 12:44:31.209500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7ef656c0ca2943eb965bf10d4e943d27", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:44:31.209500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:44:31.209500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:44:31.209500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:44:31.209500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:44:31.209500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Id: default May 26 12:44:31.209500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Name: Default May 26 12:44:31.209500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Id: 7b14606965a74c71881595c71bdd2d58 May 26 12:44:31.209500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Name: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:44:31.209500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: method: > May 26 12:44:31.209500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: exception: Instance 0db35800-34bb-4fda-bbb9-971062a3b16f could not be found. May 26 12:44:31.209500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: action_args: {'id': '0db35800-34bb-4fda-bbb9-971062a3b16f'} May 26 12:44:31.210554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:44:31.210554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:31.210554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:44:31.210554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:44:31.210554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:44:31.210554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:44:31.210554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:44:31.210554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:44:31.210554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:44:31.210554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:44:31.210554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0db35800-34bb-4fda-bbb9-971062a3b16f could not be found. May 26 12:44:31.210554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:31.210554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:31.210554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:31.210554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:31.210554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:31.210554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:31.210554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:44:31.210554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:44:31.210554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:44:31.212064 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:44:31.212064 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:44:31.212064 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:44:31.212064 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:44:31.212064 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:44:31.212064 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:44:31.212064 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:44:31.212064 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:44:31.212064 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:44:31.212064 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0db35800-34bb-4fda-bbb9-971062a3b16f could not be found. May 26 12:44:31.212064 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:31.212064 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:31.212064 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:31.212064 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:31.212064 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:31.212064 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:31.212064 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:44:31.212064 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:44:31.212064 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0db35800-34bb-4fda-bbb9-971062a3b16f could not be found. May 26 12:44:31.212064 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:31.213780 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-22de414f-a916-48ef-9128-33d9773ac071 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Returning 404 to user: Instance 0db35800-34bb-4fda-bbb9-971062a3b16f could not be found. {{(pid=124134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:44:31.213780 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-22de414f-a916-48ef-9128-33d9773ac071 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f" status: 404 len: 111 microversion: 2.1 time: 0.029335 May 26 12:44:31.213780 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 567/1124] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:44:31 2022] DELETE /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:44:31.217837 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ed1c9c94-55c4-4f8c-b102-d7ab24d05bd6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:31.218444 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ed1c9c94-55c4-4f8c-b102-d7ab24d05bd6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 0db35800-34bb-4fda-bbb9-971062a3b16f] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:31.224486 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ed1c9c94-55c4-4f8c-b102-d7ab24d05bd6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:31.224981 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ed1c9c94-55c4-4f8c-b102-d7ab24d05bd6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:31.225732 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ed1c9c94-55c4-4f8c-b102-d7ab24d05bd6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:31.226177 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ed1c9c94-55c4-4f8c-b102-d7ab24d05bd6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:31.240250 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-ed1c9c94-55c4-4f8c-b102-d7ab24d05bd6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] HTTP exception thrown: Instance 0db35800-34bb-4fda-bbb9-971062a3b16f could not be found. May 26 12:44:31.241779 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ed1c9c94-55c4-4f8c-b102-d7ab24d05bd6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Request method failure captured: May 26 12:44:31.241779 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f HTTP/1.1 May 26 12:44:31.241779 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:44:31.241779 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:44:31.241779 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:44:31.241779 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:44:31.241779 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:44:31.241779 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:44:31.241779 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:44:31.241779 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:44:31.241779 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3NlvcGUyXKMcR3f44eTcb9KUX9Z1HAOP6nfmLvSlYo0JIjkhlxQnvnKs5YzuXlFyVI90MMwVyxF6G0XRw3coPQTRjw_l752cMl_otjGJnnaQ4RjUOg-dE0XHNrSgowu0nH-j9SReMVUJ7YwVfxzPS5nbVTF1HJ2aVri9hxI7XdrhVs May 26 12:44:31.241779 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:44:31.241779 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:44:31.241779 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:44:31.241779 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:44:31.241779 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:44:31.241779 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:44:31.241779 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:44:31.241779 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:44:31.241779 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:44:31.241779 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:44:31.244197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7ef656c0ca2943eb965bf10d4e943d27", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:44:31.244197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:44:31.244197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:44:31.244197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:44:31.244197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:44:31.244197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:44:31.244197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:44:31.244197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: 7b14606965a74c71881595c71bdd2d58 May 26 12:44:31.244197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:44:31.244197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: > May 26 12:44:31.244197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Instance 0db35800-34bb-4fda-bbb9-971062a3b16f could not be found. May 26 12:44:31.244197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': '0db35800-34bb-4fda-bbb9-971062a3b16f'} May 26 12:44:31.245286 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:44:31.245286 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:31.245286 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:44:31.245286 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:44:31.245286 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:44:31.245286 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:44:31.245286 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:44:31.245286 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:44:31.245286 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:44:31.245286 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:44:31.245286 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0db35800-34bb-4fda-bbb9-971062a3b16f could not be found. May 26 12:44:31.245286 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:31.245286 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:31.245286 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:31.245286 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:31.245286 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:31.245286 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:31.245286 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:44:31.245286 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:44:31.245286 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:44:31.246845 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:44:31.246845 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:44:31.246845 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:44:31.246845 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:44:31.246845 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:44:31.246845 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:44:31.246845 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:44:31.246845 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0db35800-34bb-4fda-bbb9-971062a3b16f could not be found. May 26 12:44:31.246845 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:31.246845 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:31.246845 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:31.246845 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:31.246845 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:31.246845 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:31.246845 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:44:31.246845 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:44:31.246845 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0db35800-34bb-4fda-bbb9-971062a3b16f could not be found. May 26 12:44:31.246845 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:31.248299 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ed1c9c94-55c4-4f8c-b102-d7ab24d05bd6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Returning 404 to user: Instance 0db35800-34bb-4fda-bbb9-971062a3b16f could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:44:31.248299 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ed1c9c94-55c4-4f8c-b102-d7ab24d05bd6 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f" status: 404 len: 111 microversion: 2.1 time: 0.029124 May 26 12:44:31.248299 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 558/1125] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:31 2022] GET /compute/v2.1/servers/0db35800-34bb-4fda-bbb9-971062a3b16f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:44:31.252589 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6bfe45a7-9dee-42cf-aade-8247a159625f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:31.253110 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-6bfe45a7-9dee-42cf-aade-8247a159625f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:31.259247 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6bfe45a7-9dee-42cf-aade-8247a159625f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:31.259693 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6bfe45a7-9dee-42cf-aade-8247a159625f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:31.260460 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6bfe45a7-9dee-42cf-aade-8247a159625f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:31.260928 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6bfe45a7-9dee-42cf-aade-8247a159625f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:31.274708 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.wsgi [None req-6bfe45a7-9dee-42cf-aade-8247a159625f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] HTTP exception thrown: Instance 877c410c-52d3-4dcb-b248-61708093ac8f could not be found. May 26 12:44:31.276236 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6bfe45a7-9dee-42cf-aade-8247a159625f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Request method failure captured: May 26 12:44:31.276236 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: request: DELETE /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f HTTP/1.1 May 26 12:44:31.276236 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept: application/json May 26 12:44:31.276236 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept-Encoding: identity May 26 12:44:31.276236 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Connection: close May 26 12:44:31.276236 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Length: 0 May 26 12:44:31.276236 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Type: application/json May 26 12:44:31.276236 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Host: 10.222.0.39 May 26 12:44:31.276236 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Openstack-System-Scope: None May 26 12:44:31.276236 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: User-Agent: python-urllib3/1.26.9 May 26 12:44:31.276236 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Auth-Token: gAAAAABij3NlvcGUyXKMcR3f44eTcb9KUX9Z1HAOP6nfmLvSlYo0JIjkhlxQnvnKs5YzuXlFyVI90MMwVyxF6G0XRw3coPQTRjw_l752cMl_otjGJnnaQ4RjUOg-dE0XHNrSgowu0nH-j9SReMVUJ7YwVfxzPS5nbVTF1HJ2aVri9hxI7XdrhVs May 26 12:44:31.276236 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Id: None May 26 12:44:31.276236 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Name: None May 26 12:44:31.276236 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Identity-Status: Confirmed May 26 12:44:31.276236 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Is-Admin-Project: True May 26 12:44:31.276236 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Id: default May 26 12:44:31.276236 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Name: Default May 26 12:44:31.276236 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:44:31.276236 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:44:31.276236 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Role: member,reader May 26 12:44:31.276236 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Roles: member,reader May 26 12:44:31.277815 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7ef656c0ca2943eb965bf10d4e943d27", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:44:31.277815 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:44:31.277815 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:44:31.277815 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:44:31.277815 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:44:31.277815 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Id: default May 26 12:44:31.277815 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Name: Default May 26 12:44:31.277815 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Id: 7b14606965a74c71881595c71bdd2d58 May 26 12:44:31.277815 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Name: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:44:31.277815 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: method: > May 26 12:44:31.277815 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: exception: Instance 877c410c-52d3-4dcb-b248-61708093ac8f could not be found. May 26 12:44:31.277815 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: action_args: {'id': '877c410c-52d3-4dcb-b248-61708093ac8f'} May 26 12:44:31.278659 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:44:31.278659 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:31.278659 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:44:31.278659 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:44:31.278659 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:44:31.278659 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:44:31.278659 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:44:31.278659 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:44:31.278659 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:44:31.278659 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:44:31.278659 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 877c410c-52d3-4dcb-b248-61708093ac8f could not be found. May 26 12:44:31.278659 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:31.278659 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:31.278659 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:31.278659 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:31.278659 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:31.278659 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:31.278659 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:44:31.278659 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:44:31.278659 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:44:31.280063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:44:31.280063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:44:31.280063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:44:31.280063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:44:31.280063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:44:31.280063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:44:31.280063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:44:31.280063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:44:31.280063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:44:31.280063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 877c410c-52d3-4dcb-b248-61708093ac8f could not be found. May 26 12:44:31.280063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:31.280063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:31.280063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:31.280063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:31.280063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:31.280063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:31.280063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:44:31.280063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:44:31.280063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 877c410c-52d3-4dcb-b248-61708093ac8f could not be found. May 26 12:44:31.280063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:31.281551 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6bfe45a7-9dee-42cf-aade-8247a159625f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Returning 404 to user: Instance 877c410c-52d3-4dcb-b248-61708093ac8f could not be found. {{(pid=124134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:44:31.281551 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-6bfe45a7-9dee-42cf-aade-8247a159625f tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "DELETE /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f" status: 404 len: 111 microversion: 2.1 time: 0.028994 May 26 12:44:31.281551 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 568/1126] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:44:31 2022] DELETE /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:44:31.286174 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-66ecc193-6af5-4e94-b219-1a37823f9ef4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:31.286809 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-66ecc193-6af5-4e94-b219-1a37823f9ef4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 877c410c-52d3-4dcb-b248-61708093ac8f] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:31.293970 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-66ecc193-6af5-4e94-b219-1a37823f9ef4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:31.294420 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-66ecc193-6af5-4e94-b219-1a37823f9ef4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:31.295226 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-66ecc193-6af5-4e94-b219-1a37823f9ef4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:31.295673 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-66ecc193-6af5-4e94-b219-1a37823f9ef4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:31.312594 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-66ecc193-6af5-4e94-b219-1a37823f9ef4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] HTTP exception thrown: Instance 877c410c-52d3-4dcb-b248-61708093ac8f could not be found. May 26 12:44:31.315225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-66ecc193-6af5-4e94-b219-1a37823f9ef4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Request method failure captured: May 26 12:44:31.315225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f HTTP/1.1 May 26 12:44:31.315225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:44:31.315225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:44:31.315225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:44:31.315225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:44:31.315225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:44:31.315225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:44:31.315225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:44:31.315225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:44:31.315225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3NlvcGUyXKMcR3f44eTcb9KUX9Z1HAOP6nfmLvSlYo0JIjkhlxQnvnKs5YzuXlFyVI90MMwVyxF6G0XRw3coPQTRjw_l752cMl_otjGJnnaQ4RjUOg-dE0XHNrSgowu0nH-j9SReMVUJ7YwVfxzPS5nbVTF1HJ2aVri9hxI7XdrhVs May 26 12:44:31.315225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:44:31.315225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:44:31.315225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:44:31.315225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:44:31.315225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:44:31.315225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:44:31.315225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:44:31.315225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:44:31.315225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:44:31.315225 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:44:31.317080 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7ef656c0ca2943eb965bf10d4e943d27", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:44:31.317080 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:44:31.317080 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:44:31.317080 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:44:31.317080 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:44:31.317080 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:44:31.317080 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:44:31.317080 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: 7b14606965a74c71881595c71bdd2d58 May 26 12:44:31.317080 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:44:31.317080 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: > May 26 12:44:31.317080 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Instance 877c410c-52d3-4dcb-b248-61708093ac8f could not be found. May 26 12:44:31.317080 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': '877c410c-52d3-4dcb-b248-61708093ac8f'} May 26 12:44:31.318060 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:44:31.318060 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:31.318060 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:44:31.318060 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:44:31.318060 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:44:31.318060 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:44:31.318060 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:44:31.318060 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:44:31.318060 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:44:31.318060 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:44:31.318060 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 877c410c-52d3-4dcb-b248-61708093ac8f could not be found. May 26 12:44:31.318060 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:31.318060 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:31.318060 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:31.318060 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:31.318060 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:31.318060 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:31.318060 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:44:31.318060 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:44:31.318060 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:44:31.319304 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:44:31.319304 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:44:31.319304 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:44:31.319304 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:44:31.319304 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:44:31.319304 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:44:31.319304 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:44:31.319304 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 877c410c-52d3-4dcb-b248-61708093ac8f could not be found. May 26 12:44:31.319304 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:31.319304 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:31.319304 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:31.319304 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:31.319304 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:31.319304 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:31.319304 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:44:31.319304 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:44:31.319304 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 877c410c-52d3-4dcb-b248-61708093ac8f could not be found. May 26 12:44:31.319304 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:31.320389 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-66ecc193-6af5-4e94-b219-1a37823f9ef4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Returning 404 to user: Instance 877c410c-52d3-4dcb-b248-61708093ac8f could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:44:31.320389 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-66ecc193-6af5-4e94-b219-1a37823f9ef4 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f" status: 404 len: 111 microversion: 2.1 time: 0.034854 May 26 12:44:31.320389 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 559/1127] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:31 2022] GET /compute/v2.1/servers/877c410c-52d3-4dcb-b248-61708093ac8f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:44:32.016649 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-06ac572a-7849-4f71-81e6-470958946a67 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:32.017158 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-06ac572a-7849-4f71-81e6-470958946a67 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:32.024029 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-06ac572a-7849-4f71-81e6-470958946a67 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:32.025635 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-06ac572a-7849-4f71-81e6-470958946a67 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:32.026416 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-06ac572a-7849-4f71-81e6-470958946a67 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:32.026861 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-06ac572a-7849-4f71-81e6-470958946a67 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:32.040792 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.wsgi [None req-06ac572a-7849-4f71-81e6-470958946a67 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] HTTP exception thrown: Instance 1220de98-5d9e-4c46-937d-52199dd249c3 could not be found. May 26 12:44:32.042311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-06ac572a-7849-4f71-81e6-470958946a67 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Request method failure captured: May 26 12:44:32.042311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: request: DELETE /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 HTTP/1.1 May 26 12:44:32.042311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept: application/json May 26 12:44:32.042311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept-Encoding: identity May 26 12:44:32.042311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Connection: close May 26 12:44:32.042311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Length: 0 May 26 12:44:32.042311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Type: application/json May 26 12:44:32.042311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Host: 10.222.0.39 May 26 12:44:32.042311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Openstack-System-Scope: None May 26 12:44:32.042311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: User-Agent: python-urllib3/1.26.9 May 26 12:44:32.042311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Auth-Token: gAAAAABij3Pu-saym90ZugmL3MHfzkh3-IPtVZXgzoR3exsnu8n8HoKOTtd8zpUAVsLjhxBU3j_zoT72IpEaxwJiXS--zqSas-twRwX9KEZXcZudPVAXGqSRSYJW1jsHAcB8R-kToK2lzxh_xwqg51Jpvzf-AAGhDWT6Uu6U-Dd3iI5K6i0lhdY May 26 12:44:32.042311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Id: None May 26 12:44:32.042311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Name: None May 26 12:44:32.042311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Identity-Status: Confirmed May 26 12:44:32.042311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Is-Admin-Project: True May 26 12:44:32.042311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Id: default May 26 12:44:32.042311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Name: Default May 26 12:44:32.042311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Id: 079362a77e344c61af67f7b256545329 May 26 12:44:32.042311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Name: tempest-AttachVolumeTestJSON-1419980377 May 26 12:44:32.042311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Role: member,reader May 26 12:44:32.042311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Roles: member,reader May 26 12:44:32.043911 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/079362a77e344c61af67f7b256545329"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_079362a77e344c61af67f7b256545329", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/079362a77e344c61af67f7b256545329"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/079362a77e344c61af67f7b256545329"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:44:32.043911 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant: tempest-AttachVolumeTestJSON-1419980377 May 26 12:44:32.043911 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Id: 079362a77e344c61af67f7b256545329 May 26 12:44:32.043911 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1419980377 May 26 12:44:32.043911 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User: tempest-AttachVolumeTestJSON-1419980377-project May 26 12:44:32.043911 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Id: default May 26 12:44:32.043911 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Name: Default May 26 12:44:32.043911 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Id: 1156b006d6e1426a84a521d397491135 May 26 12:44:32.043911 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Name: tempest-AttachVolumeTestJSON-1419980377-project May 26 12:44:32.043911 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: method: > May 26 12:44:32.043911 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: exception: Instance 1220de98-5d9e-4c46-937d-52199dd249c3 could not be found. May 26 12:44:32.043911 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: action_args: {'id': '1220de98-5d9e-4c46-937d-52199dd249c3'} May 26 12:44:32.044688 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:44:32.044688 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:32.044688 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:44:32.044688 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:44:32.044688 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:44:32.044688 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:44:32.044688 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:44:32.044688 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:44:32.044688 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:44:32.044688 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:44:32.044688 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1220de98-5d9e-4c46-937d-52199dd249c3 could not be found. May 26 12:44:32.044688 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:32.044688 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:32.044688 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:32.044688 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:32.044688 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:32.044688 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:32.044688 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:44:32.044688 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:44:32.044688 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:44:32.045976 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:44:32.045976 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:44:32.045976 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:44:32.045976 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:44:32.045976 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:44:32.045976 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:44:32.045976 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:44:32.045976 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:44:32.045976 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:44:32.045976 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1220de98-5d9e-4c46-937d-52199dd249c3 could not be found. May 26 12:44:32.045976 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:32.045976 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:32.045976 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:32.045976 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:32.045976 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:32.045976 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:32.045976 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:44:32.045976 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:44:32.045976 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1220de98-5d9e-4c46-937d-52199dd249c3 could not be found. May 26 12:44:32.045976 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:32.047683 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-06ac572a-7849-4f71-81e6-470958946a67 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Returning 404 to user: Instance 1220de98-5d9e-4c46-937d-52199dd249c3 could not be found. {{(pid=124134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:44:32.047683 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-06ac572a-7849-4f71-81e6-470958946a67 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 404 len: 111 microversion: 2.1 time: 0.030839 May 26 12:44:32.047683 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 569/1128] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:44:32 2022] DELETE /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:44:32.052015 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e22d0cbd-86fe-4839-bb67-e4338cee7e31 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:32.052629 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e22d0cbd-86fe-4839-bb67-e4338cee7e31 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] [instance: 1220de98-5d9e-4c46-937d-52199dd249c3] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:32.059619 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e22d0cbd-86fe-4839-bb67-e4338cee7e31 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:32.060075 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e22d0cbd-86fe-4839-bb67-e4338cee7e31 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:32.060873 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e22d0cbd-86fe-4839-bb67-e4338cee7e31 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:32.061324 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e22d0cbd-86fe-4839-bb67-e4338cee7e31 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:32.075288 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-e22d0cbd-86fe-4839-bb67-e4338cee7e31 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] HTTP exception thrown: Instance 1220de98-5d9e-4c46-937d-52199dd249c3 could not be found. May 26 12:44:32.076820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e22d0cbd-86fe-4839-bb67-e4338cee7e31 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Request method failure captured: May 26 12:44:32.076820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 HTTP/1.1 May 26 12:44:32.076820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:44:32.076820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:44:32.076820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:44:32.076820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:44:32.076820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:44:32.076820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:44:32.076820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:44:32.076820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:44:32.076820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3Pu-saym90ZugmL3MHfzkh3-IPtVZXgzoR3exsnu8n8HoKOTtd8zpUAVsLjhxBU3j_zoT72IpEaxwJiXS--zqSas-twRwX9KEZXcZudPVAXGqSRSYJW1jsHAcB8R-kToK2lzxh_xwqg51Jpvzf-AAGhDWT6Uu6U-Dd3iI5K6i0lhdY May 26 12:44:32.076820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:44:32.076820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:44:32.076820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:44:32.076820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:44:32.076820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:44:32.076820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:44:32.076820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: 079362a77e344c61af67f7b256545329 May 26 12:44:32.076820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-AttachVolumeTestJSON-1419980377 May 26 12:44:32.076820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:44:32.076820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:44:32.078400 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/079362a77e344c61af67f7b256545329"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_079362a77e344c61af67f7b256545329", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/079362a77e344c61af67f7b256545329"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/079362a77e344c61af67f7b256545329"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:44:32.078400 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-AttachVolumeTestJSON-1419980377 May 26 12:44:32.078400 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: 079362a77e344c61af67f7b256545329 May 26 12:44:32.078400 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1419980377 May 26 12:44:32.078400 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-AttachVolumeTestJSON-1419980377-project May 26 12:44:32.078400 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:44:32.078400 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:44:32.078400 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: 1156b006d6e1426a84a521d397491135 May 26 12:44:32.078400 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-AttachVolumeTestJSON-1419980377-project May 26 12:44:32.078400 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: > May 26 12:44:32.078400 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Instance 1220de98-5d9e-4c46-937d-52199dd249c3 could not be found. May 26 12:44:32.078400 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': '1220de98-5d9e-4c46-937d-52199dd249c3'} May 26 12:44:32.079289 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:44:32.079289 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:32.079289 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:44:32.079289 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:44:32.079289 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:44:32.079289 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:44:32.079289 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:44:32.079289 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:44:32.079289 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:44:32.079289 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:44:32.079289 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1220de98-5d9e-4c46-937d-52199dd249c3 could not be found. May 26 12:44:32.079289 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:32.079289 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:32.079289 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:32.079289 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:32.079289 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:32.079289 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:32.079289 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:44:32.079289 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:44:32.079289 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:44:32.080832 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:44:32.080832 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:44:32.080832 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:44:32.080832 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:44:32.080832 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:44:32.080832 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:44:32.080832 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:44:32.080832 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1220de98-5d9e-4c46-937d-52199dd249c3 could not be found. May 26 12:44:32.080832 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:32.080832 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:32.080832 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:32.080832 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:32.080832 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:32.080832 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:32.080832 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:44:32.080832 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:44:32.080832 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1220de98-5d9e-4c46-937d-52199dd249c3 could not be found. May 26 12:44:32.080832 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:32.082281 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e22d0cbd-86fe-4839-bb67-e4338cee7e31 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] Returning 404 to user: Instance 1220de98-5d9e-4c46-937d-52199dd249c3 could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:44:32.082281 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e22d0cbd-86fe-4839-bb67-e4338cee7e31 tempest-AttachVolumeTestJSON-1419980377 tempest-AttachVolumeTestJSON-1419980377-project] 10.222.0.39 "GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3" status: 404 len: 111 microversion: 2.1 time: 0.030078 May 26 12:44:32.082281 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 560/1129] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:32 2022] GET /compute/v2.1/servers/1220de98-5d9e-4c46-937d-52199dd249c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:44:32.455697 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f7abefab-20c3-4c4e-b1e5-c53a1e1887eb tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:32.456321 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-f7abefab-20c3-4c4e-b1e5-c53a1e1887eb tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:32.463496 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f7abefab-20c3-4c4e-b1e5-c53a1e1887eb tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:32.464096 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f7abefab-20c3-4c4e-b1e5-c53a1e1887eb tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:32.464986 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f7abefab-20c3-4c4e-b1e5-c53a1e1887eb tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:32.465336 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f7abefab-20c3-4c4e-b1e5-c53a1e1887eb tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:32.479569 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.wsgi [None req-f7abefab-20c3-4c4e-b1e5-c53a1e1887eb tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] HTTP exception thrown: Instance 1cfc21dd-efee-45cb-9462-cdd0025a5038 could not be found. May 26 12:44:32.481156 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f7abefab-20c3-4c4e-b1e5-c53a1e1887eb tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Request method failure captured: May 26 12:44:32.481156 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: request: DELETE /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 HTTP/1.1 May 26 12:44:32.481156 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept: application/json May 26 12:44:32.481156 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept-Encoding: identity May 26 12:44:32.481156 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Connection: close May 26 12:44:32.481156 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Length: 0 May 26 12:44:32.481156 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Type: application/json May 26 12:44:32.481156 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Host: 10.222.0.39 May 26 12:44:32.481156 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Openstack-System-Scope: None May 26 12:44:32.481156 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: User-Agent: python-urllib3/1.26.9 May 26 12:44:32.481156 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Auth-Token: gAAAAABij3NlvcGUyXKMcR3f44eTcb9KUX9Z1HAOP6nfmLvSlYo0JIjkhlxQnvnKs5YzuXlFyVI90MMwVyxF6G0XRw3coPQTRjw_l752cMl_otjGJnnaQ4RjUOg-dE0XHNrSgowu0nH-j9SReMVUJ7YwVfxzPS5nbVTF1HJ2aVri9hxI7XdrhVs May 26 12:44:32.481156 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Id: None May 26 12:44:32.481156 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Name: None May 26 12:44:32.481156 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Identity-Status: Confirmed May 26 12:44:32.481156 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Is-Admin-Project: True May 26 12:44:32.481156 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Id: default May 26 12:44:32.481156 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Name: Default May 26 12:44:32.481156 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:44:32.481156 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:44:32.481156 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Role: member,reader May 26 12:44:32.481156 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Roles: member,reader May 26 12:44:32.482734 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7ef656c0ca2943eb965bf10d4e943d27", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:44:32.482734 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:44:32.482734 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:44:32.482734 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:44:32.482734 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:44:32.482734 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Id: default May 26 12:44:32.482734 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Name: Default May 26 12:44:32.482734 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Id: 7b14606965a74c71881595c71bdd2d58 May 26 12:44:32.482734 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Name: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:44:32.482734 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: method: > May 26 12:44:32.482734 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: exception: Instance 1cfc21dd-efee-45cb-9462-cdd0025a5038 could not be found. May 26 12:44:32.482734 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: action_args: {'id': '1cfc21dd-efee-45cb-9462-cdd0025a5038'} May 26 12:44:32.483615 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:44:32.483615 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:32.483615 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:44:32.483615 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:44:32.483615 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:44:32.483615 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:44:32.483615 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:44:32.483615 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:44:32.483615 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:44:32.483615 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:44:32.483615 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cfc21dd-efee-45cb-9462-cdd0025a5038 could not be found. May 26 12:44:32.483615 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:32.483615 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:32.483615 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:32.483615 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:32.483615 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:32.483615 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:32.483615 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:44:32.483615 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:44:32.483615 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:44:32.485160 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:44:32.485160 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:44:32.485160 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:44:32.485160 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:44:32.485160 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:44:32.485160 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:44:32.485160 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:44:32.485160 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:44:32.485160 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:44:32.485160 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cfc21dd-efee-45cb-9462-cdd0025a5038 could not be found. May 26 12:44:32.485160 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:32.485160 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:32.485160 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:32.485160 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:32.485160 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:32.485160 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:32.485160 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:44:32.485160 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:44:32.485160 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cfc21dd-efee-45cb-9462-cdd0025a5038 could not be found. May 26 12:44:32.485160 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:32.487262 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f7abefab-20c3-4c4e-b1e5-c53a1e1887eb tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Returning 404 to user: Instance 1cfc21dd-efee-45cb-9462-cdd0025a5038 could not be found. {{(pid=124134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:44:32.488103 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-f7abefab-20c3-4c4e-b1e5-c53a1e1887eb tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 404 len: 111 microversion: 2.1 time: 0.036248 May 26 12:44:32.488973 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 570/1130] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:44:32 2022] DELETE /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:44:32.497468 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-fcc16c5e-10ba-4742-8ea3-0079035a5426 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:32.498085 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-fcc16c5e-10ba-4742-8ea3-0079035a5426 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] [instance: 1cfc21dd-efee-45cb-9462-cdd0025a5038] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:32.504003 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fcc16c5e-10ba-4742-8ea3-0079035a5426 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:32.504423 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fcc16c5e-10ba-4742-8ea3-0079035a5426 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:32.509585 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fcc16c5e-10ba-4742-8ea3-0079035a5426 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:32.510454 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fcc16c5e-10ba-4742-8ea3-0079035a5426 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:32.520925 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b79ef8c5-3f13-47b4-a2d2-3d1721251bb6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:32.521848 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b79ef8c5-3f13-47b4-a2d2-3d1721251bb6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:32.526799 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-fcc16c5e-10ba-4742-8ea3-0079035a5426 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] HTTP exception thrown: Instance 1cfc21dd-efee-45cb-9462-cdd0025a5038 could not be found. May 26 12:44:32.528312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-fcc16c5e-10ba-4742-8ea3-0079035a5426 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Request method failure captured: May 26 12:44:32.528312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 HTTP/1.1 May 26 12:44:32.528312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:44:32.528312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:44:32.528312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:44:32.528312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:44:32.528312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:44:32.528312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:44:32.528312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:44:32.528312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:44:32.528312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3NlvcGUyXKMcR3f44eTcb9KUX9Z1HAOP6nfmLvSlYo0JIjkhlxQnvnKs5YzuXlFyVI90MMwVyxF6G0XRw3coPQTRjw_l752cMl_otjGJnnaQ4RjUOg-dE0XHNrSgowu0nH-j9SReMVUJ7YwVfxzPS5nbVTF1HJ2aVri9hxI7XdrhVs May 26 12:44:32.528312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:44:32.528312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:44:32.528312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:44:32.528312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:44:32.528312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:44:32.528312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:44:32.528312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:44:32.528312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:44:32.528312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:44:32.528312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:44:32.529701 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7ef656c0ca2943eb965bf10d4e943d27", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7ef656c0ca2943eb965bf10d4e943d27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:44:32.529701 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:44:32.529701 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: 7ef656c0ca2943eb965bf10d4e943d27 May 26 12:44:32.529701 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1401277318 May 26 12:44:32.529701 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:44:32.529701 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:44:32.529701 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:44:32.529701 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: 7b14606965a74c71881595c71bdd2d58 May 26 12:44:32.529701 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-AttachVolumeNegativeTest-1401277318-project May 26 12:44:32.529701 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: > May 26 12:44:32.529701 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Instance 1cfc21dd-efee-45cb-9462-cdd0025a5038 could not be found. May 26 12:44:32.529701 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': '1cfc21dd-efee-45cb-9462-cdd0025a5038'} May 26 12:44:32.530466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:44:32.530466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:32.530466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:44:32.530466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:44:32.530466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:44:32.530466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:44:32.530466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:44:32.530466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:44:32.530466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:44:32.530466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:44:32.530466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cfc21dd-efee-45cb-9462-cdd0025a5038 could not be found. May 26 12:44:32.530466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:32.530466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:32.530466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:32.530466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:32.530466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:32.530466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:32.530466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:44:32.530466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:44:32.530466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:44:32.531642 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:44:32.531642 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:44:32.531642 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:44:32.531642 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:44:32.531642 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:44:32.531642 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:44:32.531642 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:44:32.531642 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cfc21dd-efee-45cb-9462-cdd0025a5038 could not be found. May 26 12:44:32.531642 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:32.531642 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:32.531642 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:32.531642 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:32.531642 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:32.531642 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:32.531642 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:44:32.531642 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:44:32.531642 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cfc21dd-efee-45cb-9462-cdd0025a5038 could not be found. May 26 12:44:32.531642 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:32.532764 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b79ef8c5-3f13-47b4-a2d2-3d1721251bb6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:32.532868 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-fcc16c5e-10ba-4742-8ea3-0079035a5426 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] Returning 404 to user: Instance 1cfc21dd-efee-45cb-9462-cdd0025a5038 could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:44:32.532949 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b79ef8c5-3f13-47b4-a2d2-3d1721251bb6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:32.532949 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b79ef8c5-3f13-47b4-a2d2-3d1721251bb6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:32.533090 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-fcc16c5e-10ba-4742-8ea3-0079035a5426 tempest-AttachVolumeNegativeTest-1401277318 tempest-AttachVolumeNegativeTest-1401277318-project] 10.222.0.39 "GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038" status: 404 len: 111 microversion: 2.1 time: 0.037043 May 26 12:44:32.533171 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b79ef8c5-3f13-47b4-a2d2-3d1721251bb6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:32.533262 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 561/1131] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:32 2022] GET /compute/v2.1/servers/1cfc21dd-efee-45cb-9462-cdd0025a5038 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:44:32.561860 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b79ef8c5-3f13-47b4-a2d2-3d1721251bb6 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045192 May 26 12:44:32.562420 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 571/1132] 10.222.0.39 () {60 vars in 1342 bytes} [Thu May 26 12:44:32 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:44:32.650360 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ce5f5585-034b-43e9-8248-779adefb0ba3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:32.651082 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ce5f5585-034b-43e9-8248-779adefb0ba3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:32.657341 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ce5f5585-034b-43e9-8248-779adefb0ba3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:32.657800 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ce5f5585-034b-43e9-8248-779adefb0ba3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:32.658568 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ce5f5585-034b-43e9-8248-779adefb0ba3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:32.659178 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ce5f5585-034b-43e9-8248-779adefb0ba3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:32.686013 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ce5f5585-034b-43e9-8248-779adefb0ba3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Going to try to terminate instance {{(pid=124133) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:44:32.767291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ce5f5585-034b-43e9-8248-779adefb0ba3 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 204 len: 0 microversion: 2.20 time: 0.120308 May 26 12:44:32.769975 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 562/1133] 10.222.0.39 () {60 vars in 1279 bytes} [Thu May 26 12:44:32 2022] DELETE /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 12:44:32.779764 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-c01977c5-7b94-4799-aaa8-40471f559f6d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:32.780491 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-c01977c5-7b94-4799-aaa8-40471f559f6d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:32.787142 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c01977c5-7b94-4799-aaa8-40471f559f6d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:32.787669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c01977c5-7b94-4799-aaa8-40471f559f6d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:32.788506 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c01977c5-7b94-4799-aaa8-40471f559f6d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:32.789036 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c01977c5-7b94-4799-aaa8-40471f559f6d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:33.002298 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c01977c5-7b94-4799-aaa8-40471f559f6d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:33.011915 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c01977c5-7b94-4799-aaa8-40471f559f6d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:33.013794 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c01977c5-7b94-4799-aaa8-40471f559f6d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:33.015274 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-c01977c5-7b94-4799-aaa8-40471f559f6d tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1722 microversion: 2.20 time: 0.239717 May 26 12:44:33.025747 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 572/1134] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:44:32 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:44:34.037640 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-09067323-361e-455d-8994-f4632b45da30 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:34.039039 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-09067323-361e-455d-8994-f4632b45da30 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:34.046815 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-09067323-361e-455d-8994-f4632b45da30 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:34.047623 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-09067323-361e-455d-8994-f4632b45da30 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:34.048616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-09067323-361e-455d-8994-f4632b45da30 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:34.049333 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-09067323-361e-455d-8994-f4632b45da30 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:34.438192 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-09067323-361e-455d-8994-f4632b45da30 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:34.446495 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-09067323-361e-455d-8994-f4632b45da30 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:34.448010 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-09067323-361e-455d-8994-f4632b45da30 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:34.449512 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-09067323-361e-455d-8994-f4632b45da30 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1722 microversion: 2.20 time: 0.416568 May 26 12:44:34.450066 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 563/1135] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:44:34 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1722 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:35.468253 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b3a557fa-eed5-4d4c-ac82-80034d344a6c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:35.469012 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b3a557fa-eed5-4d4c-ac82-80034d344a6c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:35.475607 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b3a557fa-eed5-4d4c-ac82-80034d344a6c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:35.476047 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b3a557fa-eed5-4d4c-ac82-80034d344a6c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:35.476830 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b3a557fa-eed5-4d4c-ac82-80034d344a6c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:35.477975 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b3a557fa-eed5-4d4c-ac82-80034d344a6c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:35.844636 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b3a557fa-eed5-4d4c-ac82-80034d344a6c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:35.853967 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b3a557fa-eed5-4d4c-ac82-80034d344a6c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:35.855491 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b3a557fa-eed5-4d4c-ac82-80034d344a6c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:35.856780 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b3a557fa-eed5-4d4c-ac82-80034d344a6c tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1722 microversion: 2.20 time: 0.392482 May 26 12:44:35.857863 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 573/1136] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:44:35 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1722 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:36.880510 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-30a40e67-9568-41e6-a68a-8fba5aca8d87 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:36.881188 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-30a40e67-9568-41e6-a68a-8fba5aca8d87 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:36.956419 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-30a40e67-9568-41e6-a68a-8fba5aca8d87 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:36.956952 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-30a40e67-9568-41e6-a68a-8fba5aca8d87 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:36.957841 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-30a40e67-9568-41e6-a68a-8fba5aca8d87 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:36.959446 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-30a40e67-9568-41e6-a68a-8fba5aca8d87 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:37.128400 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-30a40e67-9568-41e6-a68a-8fba5aca8d87 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:37.154641 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-30a40e67-9568-41e6-a68a-8fba5aca8d87 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:37.156103 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-30a40e67-9568-41e6-a68a-8fba5aca8d87 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c90e6a7a7265480ca4c817d633da4a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '978105ae032049cd85c3b1c061d10a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:37.163468 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-30a40e67-9568-41e6-a68a-8fba5aca8d87 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 200 len: 1655 microversion: 2.20 time: 0.290198 May 26 12:44:37.166553 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 564/1137] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:44:36 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 1655 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:37.218266 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-cac5efc7-519f-4687-8f67-384d509cf256 req-d37f2bdd-d0de-4469-95e7-1c02c47ee9b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2", "name": "network-vif-deleted", "tag": "c3caaa3d-4347-42cd-a614-454eabf81b41"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:44:37.244607 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-cac5efc7-519f-4687-8f67-384d509cf256 req-d37f2bdd-d0de-4469-95e7-1c02c47ee9b0 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:37.248442 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-cac5efc7-519f-4687-8f67-384d509cf256 req-d37f2bdd-d0de-4469-95e7-1c02c47ee9b0 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:37.279266 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-cac5efc7-519f-4687-8f67-384d509cf256 req-d37f2bdd-d0de-4469-95e7-1c02c47ee9b0 service nova] Creating event network-vif-deleted:c3caaa3d-4347-42cd-a614-454eabf81b41 for instance f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 on hv-cinder-81514 May 26 12:44:37.294288 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-cac5efc7-519f-4687-8f67-384d509cf256 req-d37f2bdd-d0de-4469-95e7-1c02c47ee9b0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.383941 May 26 12:44:37.295367 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 574/1138] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:37.708459 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ed3bcad7-fb6b-4570-ba30-0f71f474e27b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:44:37.709898 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ed3bcad7-fb6b-4570-ba30-0f71f474e27b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:37.720059 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ed3bcad7-fb6b-4570-ba30-0f71f474e27b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:37.721184 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ed3bcad7-fb6b-4570-ba30-0f71f474e27b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:37.722220 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ed3bcad7-fb6b-4570-ba30-0f71f474e27b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:37.723063 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ed3bcad7-fb6b-4570-ba30-0f71f474e27b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:37.816437 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ed3bcad7-fb6b-4570-ba30-0f71f474e27b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "POST /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9/action" status: 202 len: 0 microversion: 2.1 time: 0.118947 May 26 12:44:37.820746 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 565/1139] 10.222.0.39 () {60 vars in 1277 bytes} [Thu May 26 12:44:37 2022] POST /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:44:37.828030 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-bdf26335-7ac6-4eca-9a42-34e39c11a37b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:37.828766 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-bdf26335-7ac6-4eca-9a42-34e39c11a37b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:37.857454 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bdf26335-7ac6-4eca-9a42-34e39c11a37b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:37.858141 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bdf26335-7ac6-4eca-9a42-34e39c11a37b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:37.859412 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bdf26335-7ac6-4eca-9a42-34e39c11a37b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:37.867544 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-bdf26335-7ac6-4eca-9a42-34e39c11a37b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:38.181363 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-bdf26335-7ac6-4eca-9a42-34e39c11a37b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:38.184884 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-45818eab-54c0-4edf-88fd-f06ff0337a4a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:38.186160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-45818eab-54c0-4edf-88fd-f06ff0337a4a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:38.195326 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-45818eab-54c0-4edf-88fd-f06ff0337a4a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:38.195789 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-45818eab-54c0-4edf-88fd-f06ff0337a4a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:38.197167 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-45818eab-54c0-4edf-88fd-f06ff0337a4a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:38.197688 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-45818eab-54c0-4edf-88fd-f06ff0337a4a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:38.198028 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-bdf26335-7ac6-4eca-9a42-34e39c11a37b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1752 microversion: 2.1 time: 0.374325 May 26 12:44:38.198617 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 575/1140] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:37 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1752 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:38.221599 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-45818eab-54c0-4edf-88fd-f06ff0337a4a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] HTTP exception thrown: Instance f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 could not be found. May 26 12:44:38.223251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-45818eab-54c0-4edf-88fd-f06ff0337a4a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Request method failure captured: May 26 12:44:38.223251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 HTTP/1.1 May 26 12:44:38.223251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:44:38.223251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:44:38.223251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:44:38.223251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:44:38.223251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:44:38.223251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:44:38.223251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:44:38.223251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:44:38.223251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3NupQ99bdm0jSYtBpFOsR_TpeZZBFaPjT6l5q8y92nkUanj933uElOcB1O4u6r9jKp9lNpjs6xH0xR_cLoz5pmuJvw1elutYyrD-SzLOSA2pQ1M-mifWxzqkZCOqaG-rR2dl3EmFfEaetSOx7i4l7GX0qf4YfrlFCh6hWL2MN5BV5w May 26 12:44:38.223251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:44:38.223251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:44:38.223251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:44:38.223251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:44:38.223251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Openstack-Nova-Api-Version: 2.20 May 26 12:44:38.223251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:44:38.223251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:44:38.223251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: 978105ae032049cd85c3b1c061d10a24 May 26 12:44:38.223251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-282052064 May 26 12:44:38.223251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:44:38.223251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:44:38.224680 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/978105ae032049cd85c3b1c061d10a24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_978105ae032049cd85c3b1c061d10a24", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/978105ae032049cd85c3b1c061d10a24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/978105ae032049cd85c3b1c061d10a24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:44:38.224680 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-AttachVolumeShelveTestJSON-282052064 May 26 12:44:38.224680 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: 978105ae032049cd85c3b1c061d10a24 May 26 12:44:38.224680 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-282052064 May 26 12:44:38.224680 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-AttachVolumeShelveTestJSON-282052064-project May 26 12:44:38.224680 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:44:38.224680 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:44:38.224680 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: c90e6a7a7265480ca4c817d633da4a1d May 26 12:44:38.224680 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-AttachVolumeShelveTestJSON-282052064-project May 26 12:44:38.224680 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: > May 26 12:44:38.224680 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Instance f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 could not be found. May 26 12:44:38.224680 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': 'f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2'} May 26 12:44:38.225574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:44:38.225574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:38.225574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:44:38.225574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:44:38.225574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:44:38.225574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:44:38.225574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:44:38.225574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:44:38.225574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:44:38.225574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:44:38.225574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 could not be found. May 26 12:44:38.225574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:38.225574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:38.225574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:38.225574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:38.225574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:38.225574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:38.225574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:44:38.225574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:44:38.225574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:44:38.226775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:44:38.226775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:44:38.226775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:44:38.226775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:44:38.226775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:44:38.226775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:44:38.226775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:44:38.226775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 could not be found. May 26 12:44:38.226775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:38.226775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:38.226775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:38.226775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:38.226775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:38.226775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:38.226775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:44:38.226775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:44:38.226775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 could not be found. May 26 12:44:38.226775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:38.241461 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-45818eab-54c0-4edf-88fd-f06ff0337a4a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Returning 404 to user: Instance f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:44:38.242288 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-45818eab-54c0-4edf-88fd-f06ff0337a4a tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 404 len: 111 microversion: 2.20 time: 0.063139 May 26 12:44:38.243455 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 566/1141] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:44:38 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 26 12:44:38.253031 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-443b140a-2cc5-49ae-bbac-3474e0d137ca tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '.version_select at 0x7fed31cd5940>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:38.289635 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-443b140a-2cc5-49ae-bbac-3474e0d137ca tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-409721583" status: 204 len: 0 microversion: 2.20 time: 0.040638 May 26 12:44:38.290800 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 576/1142] 10.222.0.39 () {60 vars in 1258 bytes} [Thu May 26 12:44:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-409721583 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 12:44:39.217170 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-b9d63f8e-297f-48b5-9d69-bcc917b63cf1 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:39.217932 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-b9d63f8e-297f-48b5-9d69-bcc917b63cf1 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:39.225376 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b9d63f8e-297f-48b5-9d69-bcc917b63cf1 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:39.226163 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b9d63f8e-297f-48b5-9d69-bcc917b63cf1 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:39.226950 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b9d63f8e-297f-48b5-9d69-bcc917b63cf1 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:39.228159 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b9d63f8e-297f-48b5-9d69-bcc917b63cf1 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:39.420209 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-b9d63f8e-297f-48b5-9d69-bcc917b63cf1 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:39.433775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-b9d63f8e-297f-48b5-9d69-bcc917b63cf1 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1757 microversion: 2.1 time: 0.221886 May 26 12:44:39.434368 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 567/1143] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:39 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1757 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:39.752884 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-bca243bc-fab5-4741-a50d-40b874c2462f tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] Action: 'create', calling method: .version_select at 0x7fed31cac700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1737608157"}} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:44:40.078887 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-bca243bc-fab5-4741-a50d-40b874c2462f tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.462545 May 26 12:44:40.079721 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 577/1144] 10.222.0.39 () {60 vars in 1154 bytes} [Thu May 26 12:44:39 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 464 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 26 12:44:40.090872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f265d50d-8706-48a1-9c3f-b19cb0963078 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] Calling method '.version_select at 0x7fed3134aee0>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:40.150439 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f265d50d-8706-48a1-9c3f-b19cb0963078 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/814bafc1-1c19-415a-ad0a-26c80c767cf4" status: 200 len: 345 microversion: 2.1 time: 0.063443 May 26 12:44:40.151000 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 568/1145] 10.222.0.39 () {58 vars in 1244 bytes} [Thu May 26 12:44:40 2022] GET /compute/v2.1/os-volumes/814bafc1-1c19-415a-ad0a-26c80c767cf4 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:40.435512 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-7f0b0e16-675a-409a-b4df-e0f65081808b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:40.436011 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-7f0b0e16-675a-409a-b4df-e0f65081808b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:40.443063 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7f0b0e16-675a-409a-b4df-e0f65081808b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:40.443518 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7f0b0e16-675a-409a-b4df-e0f65081808b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:40.444282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7f0b0e16-675a-409a-b4df-e0f65081808b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:40.444747 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7f0b0e16-675a-409a-b4df-e0f65081808b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:40.452509 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-29373795-65db-4ac2-a4dd-444c8735c473 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:40.454384 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-29373795-65db-4ac2-a4dd-444c8735c473 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:40.462578 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-29373795-65db-4ac2-a4dd-444c8735c473 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:40.463371 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-29373795-65db-4ac2-a4dd-444c8735c473 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:40.464267 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-29373795-65db-4ac2-a4dd-444c8735c473 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:40.464994 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-29373795-65db-4ac2-a4dd-444c8735c473 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:40.474625 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.wsgi [None req-7f0b0e16-675a-409a-b4df-e0f65081808b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] HTTP exception thrown: Instance f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 could not be found. May 26 12:44:40.476555 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-7f0b0e16-675a-409a-b4df-e0f65081808b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Request method failure captured: May 26 12:44:40.476555 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: request: DELETE /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 HTTP/1.1 May 26 12:44:40.476555 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept: application/json May 26 12:44:40.476555 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept-Encoding: identity May 26 12:44:40.476555 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Connection: close May 26 12:44:40.476555 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Length: 0 May 26 12:44:40.476555 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Type: application/json May 26 12:44:40.476555 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Host: 10.222.0.39 May 26 12:44:40.476555 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Openstack-System-Scope: None May 26 12:44:40.476555 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: User-Agent: python-urllib3/1.26.9 May 26 12:44:40.476555 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Auth-Token: gAAAAABij3NupQ99bdm0jSYtBpFOsR_TpeZZBFaPjT6l5q8y92nkUanj933uElOcB1O4u6r9jKp9lNpjs6xH0xR_cLoz5pmuJvw1elutYyrD-SzLOSA2pQ1M-mifWxzqkZCOqaG-rR2dl3EmFfEaetSOx7i4l7GX0qf4YfrlFCh6hWL2MN5BV5w May 26 12:44:40.476555 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Id: None May 26 12:44:40.476555 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Name: None May 26 12:44:40.476555 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Identity-Status: Confirmed May 26 12:44:40.476555 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Is-Admin-Project: True May 26 12:44:40.476555 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Openstack-Nova-Api-Version: 2.20 May 26 12:44:40.476555 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Id: default May 26 12:44:40.476555 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Name: Default May 26 12:44:40.476555 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Id: 978105ae032049cd85c3b1c061d10a24 May 26 12:44:40.476555 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-282052064 May 26 12:44:40.476555 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Role: member,reader May 26 12:44:40.476555 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Roles: member,reader May 26 12:44:40.478967 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/978105ae032049cd85c3b1c061d10a24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_978105ae032049cd85c3b1c061d10a24", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/978105ae032049cd85c3b1c061d10a24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/978105ae032049cd85c3b1c061d10a24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:44:40.478967 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant: tempest-AttachVolumeShelveTestJSON-282052064 May 26 12:44:40.478967 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Id: 978105ae032049cd85c3b1c061d10a24 May 26 12:44:40.478967 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-282052064 May 26 12:44:40.478967 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User: tempest-AttachVolumeShelveTestJSON-282052064-project May 26 12:44:40.478967 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Id: default May 26 12:44:40.478967 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Name: Default May 26 12:44:40.478967 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Id: c90e6a7a7265480ca4c817d633da4a1d May 26 12:44:40.478967 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Name: tempest-AttachVolumeShelveTestJSON-282052064-project May 26 12:44:40.478967 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: method: > May 26 12:44:40.478967 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: exception: Instance f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 could not be found. May 26 12:44:40.478967 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: action_args: {'id': 'f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2'} May 26 12:44:40.479916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:44:40.479916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:40.479916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:44:40.479916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:44:40.479916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:44:40.479916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:44:40.479916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:44:40.479916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:44:40.479916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:44:40.479916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:44:40.479916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 could not be found. May 26 12:44:40.479916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:40.479916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:40.479916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:40.479916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:40.479916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:40.479916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:40.479916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:44:40.479916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:44:40.479916 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:44:40.481468 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:44:40.481468 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:44:40.481468 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:44:40.481468 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:44:40.481468 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:44:40.481468 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:44:40.481468 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:44:40.481468 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:44:40.481468 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:44:40.481468 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 could not be found. May 26 12:44:40.481468 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:40.481468 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:40.481468 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:40.481468 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:40.481468 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:40.481468 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:40.481468 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:44:40.481468 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:44:40.481468 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 could not be found. May 26 12:44:40.481468 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:40.483623 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-7f0b0e16-675a-409a-b4df-e0f65081808b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Returning 404 to user: Instance f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 could not be found. {{(pid=124134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:44:40.484962 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-7f0b0e16-675a-409a-b4df-e0f65081808b tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 404 len: 111 microversion: 2.20 time: 0.053620 May 26 12:44:40.485670 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 578/1146] 10.222.0.39 () {60 vars in 1279 bytes} [Thu May 26 12:44:40 2022] DELETE /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 12:44:40.494497 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e636289b-03f4-4ebb-9d07-b10f8ac4f849 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:40.495510 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-e636289b-03f4-4ebb-9d07-b10f8ac4f849 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:40.502101 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e636289b-03f4-4ebb-9d07-b10f8ac4f849 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:40.502565 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e636289b-03f4-4ebb-9d07-b10f8ac4f849 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:40.503438 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e636289b-03f4-4ebb-9d07-b10f8ac4f849 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:40.504023 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e636289b-03f4-4ebb-9d07-b10f8ac4f849 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:40.517474 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.wsgi [None req-e636289b-03f4-4ebb-9d07-b10f8ac4f849 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] HTTP exception thrown: Instance f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 could not be found. May 26 12:44:40.519282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e636289b-03f4-4ebb-9d07-b10f8ac4f849 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Request method failure captured: May 26 12:44:40.519282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: request: GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 HTTP/1.1 May 26 12:44:40.519282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept: application/json May 26 12:44:40.519282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept-Encoding: identity May 26 12:44:40.519282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Connection: close May 26 12:44:40.519282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Length: 0 May 26 12:44:40.519282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Type: application/json May 26 12:44:40.519282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Host: 10.222.0.39 May 26 12:44:40.519282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Openstack-System-Scope: None May 26 12:44:40.519282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: User-Agent: python-urllib3/1.26.9 May 26 12:44:40.519282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Auth-Token: gAAAAABij3NupQ99bdm0jSYtBpFOsR_TpeZZBFaPjT6l5q8y92nkUanj933uElOcB1O4u6r9jKp9lNpjs6xH0xR_cLoz5pmuJvw1elutYyrD-SzLOSA2pQ1M-mifWxzqkZCOqaG-rR2dl3EmFfEaetSOx7i4l7GX0qf4YfrlFCh6hWL2MN5BV5w May 26 12:44:40.519282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Id: None May 26 12:44:40.519282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Name: None May 26 12:44:40.519282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Identity-Status: Confirmed May 26 12:44:40.519282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Is-Admin-Project: True May 26 12:44:40.519282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Openstack-Nova-Api-Version: 2.20 May 26 12:44:40.519282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Id: default May 26 12:44:40.519282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Name: Default May 26 12:44:40.519282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Id: 978105ae032049cd85c3b1c061d10a24 May 26 12:44:40.519282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-282052064 May 26 12:44:40.519282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Role: member,reader May 26 12:44:40.519282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Roles: member,reader May 26 12:44:40.520913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/978105ae032049cd85c3b1c061d10a24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_978105ae032049cd85c3b1c061d10a24", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/978105ae032049cd85c3b1c061d10a24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/978105ae032049cd85c3b1c061d10a24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:44:40.520913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant: tempest-AttachVolumeShelveTestJSON-282052064 May 26 12:44:40.520913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Id: 978105ae032049cd85c3b1c061d10a24 May 26 12:44:40.520913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-282052064 May 26 12:44:40.520913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User: tempest-AttachVolumeShelveTestJSON-282052064-project May 26 12:44:40.520913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Id: default May 26 12:44:40.520913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Name: Default May 26 12:44:40.520913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Id: c90e6a7a7265480ca4c817d633da4a1d May 26 12:44:40.520913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Name: tempest-AttachVolumeShelveTestJSON-282052064-project May 26 12:44:40.520913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: method: > May 26 12:44:40.520913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: exception: Instance f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 could not be found. May 26 12:44:40.520913 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: action_args: {'id': 'f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2'} May 26 12:44:40.521669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:44:40.521669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:40.521669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:44:40.521669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:44:40.521669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:44:40.521669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:44:40.521669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:44:40.521669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:44:40.521669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:44:40.521669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:44:40.521669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 could not be found. May 26 12:44:40.521669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:40.521669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:40.521669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:40.521669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:40.521669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:40.521669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:40.521669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:44:40.521669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:44:40.521669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:44:40.523346 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:44:40.523346 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:44:40.523346 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:44:40.523346 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:44:40.523346 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:44:40.523346 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:44:40.523346 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:44:40.523346 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 could not be found. May 26 12:44:40.523346 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:40.523346 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:40.523346 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:40.523346 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:40.523346 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:40.523346 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:40.523346 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:44:40.523346 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:44:40.523346 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 could not be found. May 26 12:44:40.523346 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:40.525438 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e636289b-03f4-4ebb-9d07-b10f8ac4f849 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Returning 404 to user: Instance f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 could not be found. {{(pid=124134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:44:40.525438 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-e636289b-03f4-4ebb-9d07-b10f8ac4f849 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2" status: 404 len: 111 microversion: 2.20 time: 0.030888 May 26 12:44:40.525438 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 579/1147] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:44:40 2022] GET /compute/v2.1/servers/f13709b2-8cc9-425b-bac1-c9b8d1ea3fd2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 12:44:40.675324 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-29373795-65db-4ac2-a4dd-444c8735c473 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:40.684675 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-29373795-65db-4ac2-a4dd-444c8735c473 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1757 microversion: 2.1 time: 0.237064 May 26 12:44:40.685452 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 569/1148] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:40 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1757 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:41.164077 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-fde12138-1c83-43d5-8484-1a85f85f43c7 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] Calling method '.version_select at 0x7fed31f49af0>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:41.217683 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-fde12138-1c83-43d5-8484-1a85f85f43c7 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/814bafc1-1c19-415a-ad0a-26c80c767cf4" status: 200 len: 346 microversion: 2.1 time: 0.058350 May 26 12:44:41.218268 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 580/1149] 10.222.0.39 () {58 vars in 1244 bytes} [Thu May 26 12:44:41 2022] GET /compute/v2.1/os-volumes/814bafc1-1c19-415a-ad0a-26c80c767cf4 => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:41.230127 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-8971f421-ef8c-40d0-9661-8be65d99a801 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] Action: 'create', calling method: .version_select at 0x7fed31277ca0>, body: {"snapshot": {"volume_id": "814bafc1-1c19-415a-ad0a-26c80c767cf4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2132144024"}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:44:41.417534 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-8971f421-ef8c-40d0-9661-8be65d99a801 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] 10.222.0.39 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.191329 May 26 12:44:41.425621 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 570/1150] 10.222.0.39 () {60 vars in 1161 bytes} [Thu May 26 12:44:41 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:41.437506 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-a445d3c6-66e2-486c-840a-22ce86158911 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] Calling method '.version_select at 0x7fed314521f0>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:41.495874 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-a445d3c6-66e2-486c-840a-22ce86158911 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/047ea4f4-c4fd-42bd-8e38-5795a29edd6f" status: 200 len: 287 microversion: 2.1 time: 0.067465 May 26 12:44:41.496699 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 581/1151] 10.222.0.39 () {58 vars in 1250 bytes} [Thu May 26 12:44:41 2022] GET /compute/v2.1/os-snapshots/047ea4f4-c4fd-42bd-8e38-5795a29edd6f => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:41.507398 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-0458d5cf-2a23-49c8-969f-ed35b5a7eaad tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] Calling method '.version_select at 0x7fed3148e9d0>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:41.538307 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-0458d5cf-2a23-49c8-969f-ed35b5a7eaad tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035371 May 26 12:44:41.538870 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 571/1152] 10.222.0.39 () {58 vars in 1139 bytes} [Thu May 26 12:44:41 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:41.553605 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-a3111960-711e-4f05-8eed-edf40e207157 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] Calling method '.version_select at 0x7fed31452280>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:41.588882 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-a3111960-711e-4f05-8eed-edf40e207157 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/047ea4f4-c4fd-42bd-8e38-5795a29edd6f" status: 200 len: 287 microversion: 2.1 time: 0.039571 May 26 12:44:41.590289 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 582/1153] 10.222.0.39 () {58 vars in 1250 bytes} [Thu May 26 12:44:41 2022] GET /compute/v2.1/os-snapshots/047ea4f4-c4fd-42bd-8e38-5795a29edd6f => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:41.679773 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-c2400b7f-96b5-43c0-964d-f0fb51e56547 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:41.680576 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-c2400b7f-96b5-43c0-964d-f0fb51e56547 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:41.687776 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c2400b7f-96b5-43c0-964d-f0fb51e56547 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:41.688241 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c2400b7f-96b5-43c0-964d-f0fb51e56547 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:41.689060 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c2400b7f-96b5-43c0-964d-f0fb51e56547 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:41.689505 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c2400b7f-96b5-43c0-964d-f0fb51e56547 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:41.702235 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-be921a6b-c29e-44c0-a3de-01b9327a5689 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:41.702851 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-be921a6b-c29e-44c0-a3de-01b9327a5689 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:41.703702 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-c2400b7f-96b5-43c0-964d-f0fb51e56547 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] HTTP exception thrown: Instance 7af16d0b-59c7-43ea-856c-ec79029b680c could not be found. May 26 12:44:41.705311 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-c2400b7f-96b5-43c0-964d-f0fb51e56547 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Request method failure captured: May 26 12:44:41.705311 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: DELETE /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c HTTP/1.1 May 26 12:44:41.705311 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:44:41.705311 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:44:41.705311 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:44:41.705311 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:44:41.705311 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:44:41.705311 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:44:41.705311 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:44:41.705311 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:44:41.705311 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3NupQ99bdm0jSYtBpFOsR_TpeZZBFaPjT6l5q8y92nkUanj933uElOcB1O4u6r9jKp9lNpjs6xH0xR_cLoz5pmuJvw1elutYyrD-SzLOSA2pQ1M-mifWxzqkZCOqaG-rR2dl3EmFfEaetSOx7i4l7GX0qf4YfrlFCh6hWL2MN5BV5w May 26 12:44:41.705311 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:44:41.705311 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:44:41.705311 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:44:41.705311 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:44:41.705311 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Openstack-Nova-Api-Version: 2.20 May 26 12:44:41.705311 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:44:41.705311 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:44:41.705311 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: 978105ae032049cd85c3b1c061d10a24 May 26 12:44:41.705311 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-282052064 May 26 12:44:41.705311 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:44:41.705311 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:44:41.707096 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/978105ae032049cd85c3b1c061d10a24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_978105ae032049cd85c3b1c061d10a24", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/978105ae032049cd85c3b1c061d10a24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/978105ae032049cd85c3b1c061d10a24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:44:41.707096 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-AttachVolumeShelveTestJSON-282052064 May 26 12:44:41.707096 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: 978105ae032049cd85c3b1c061d10a24 May 26 12:44:41.707096 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-282052064 May 26 12:44:41.707096 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-AttachVolumeShelveTestJSON-282052064-project May 26 12:44:41.707096 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:44:41.707096 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:44:41.707096 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: c90e6a7a7265480ca4c817d633da4a1d May 26 12:44:41.707096 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-AttachVolumeShelveTestJSON-282052064-project May 26 12:44:41.707096 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: > May 26 12:44:41.707096 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Instance 7af16d0b-59c7-43ea-856c-ec79029b680c could not be found. May 26 12:44:41.707096 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': '7af16d0b-59c7-43ea-856c-ec79029b680c'} May 26 12:44:41.708037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:44:41.708037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:41.708037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:44:41.708037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:44:41.708037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:44:41.708037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:44:41.708037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:44:41.708037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:44:41.708037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:44:41.708037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:44:41.708037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7af16d0b-59c7-43ea-856c-ec79029b680c could not be found. May 26 12:44:41.708037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:41.708037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:41.708037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:41.708037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:41.708037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:41.708037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:41.708037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:44:41.708037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:44:41.708037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:44:41.709617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:44:41.709617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:44:41.709617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:44:41.709617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:44:41.709617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:44:41.709617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:44:41.709617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:44:41.709617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:44:41.709617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:44:41.709617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7af16d0b-59c7-43ea-856c-ec79029b680c could not be found. May 26 12:44:41.709617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:41.709617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:41.709617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:41.709617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:41.709617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:41.709617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:41.709617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:44:41.709617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:44:41.709617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7af16d0b-59c7-43ea-856c-ec79029b680c could not be found. May 26 12:44:41.709617 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:41.711162 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-be921a6b-c29e-44c0-a3de-01b9327a5689 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:41.711162 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-be921a6b-c29e-44c0-a3de-01b9327a5689 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:41.712364 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-be921a6b-c29e-44c0-a3de-01b9327a5689 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:41.712939 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-c2400b7f-96b5-43c0-964d-f0fb51e56547 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Returning 404 to user: Instance 7af16d0b-59c7-43ea-856c-ec79029b680c could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:44:41.713055 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-be921a6b-c29e-44c0-a3de-01b9327a5689 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:41.713802 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-c2400b7f-96b5-43c0-964d-f0fb51e56547 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 404 len: 111 microversion: 2.20 time: 0.038106 May 26 12:44:41.717611 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 572/1154] 10.222.0.39 () {60 vars in 1279 bytes} [Thu May 26 12:44:41 2022] DELETE /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 12:44:41.722924 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-8fe060a2-827c-4031-9e91-be6a5c071262 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:41.723487 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-8fe060a2-827c-4031-9e91-be6a5c071262 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] [instance: 7af16d0b-59c7-43ea-856c-ec79029b680c] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:41.731461 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8fe060a2-827c-4031-9e91-be6a5c071262 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:41.731918 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8fe060a2-827c-4031-9e91-be6a5c071262 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:41.732702 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8fe060a2-827c-4031-9e91-be6a5c071262 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:41.733170 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8fe060a2-827c-4031-9e91-be6a5c071262 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:41.747981 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-8fe060a2-827c-4031-9e91-be6a5c071262 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] HTTP exception thrown: Instance 7af16d0b-59c7-43ea-856c-ec79029b680c could not be found. May 26 12:44:41.749764 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-8fe060a2-827c-4031-9e91-be6a5c071262 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Request method failure captured: May 26 12:44:41.749764 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c HTTP/1.1 May 26 12:44:41.749764 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:44:41.749764 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:44:41.749764 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:44:41.749764 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:44:41.749764 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:44:41.749764 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:44:41.749764 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:44:41.749764 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:44:41.749764 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3NupQ99bdm0jSYtBpFOsR_TpeZZBFaPjT6l5q8y92nkUanj933uElOcB1O4u6r9jKp9lNpjs6xH0xR_cLoz5pmuJvw1elutYyrD-SzLOSA2pQ1M-mifWxzqkZCOqaG-rR2dl3EmFfEaetSOx7i4l7GX0qf4YfrlFCh6hWL2MN5BV5w May 26 12:44:41.749764 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:44:41.749764 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:44:41.749764 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:44:41.749764 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:44:41.749764 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Openstack-Nova-Api-Version: 2.20 May 26 12:44:41.749764 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:44:41.749764 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:44:41.749764 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: 978105ae032049cd85c3b1c061d10a24 May 26 12:44:41.749764 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-282052064 May 26 12:44:41.749764 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:44:41.749764 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:44:41.751690 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/978105ae032049cd85c3b1c061d10a24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_978105ae032049cd85c3b1c061d10a24", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/978105ae032049cd85c3b1c061d10a24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/978105ae032049cd85c3b1c061d10a24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:44:41.751690 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-AttachVolumeShelveTestJSON-282052064 May 26 12:44:41.751690 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: 978105ae032049cd85c3b1c061d10a24 May 26 12:44:41.751690 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-282052064 May 26 12:44:41.751690 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-AttachVolumeShelveTestJSON-282052064-project May 26 12:44:41.751690 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:44:41.751690 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:44:41.751690 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: c90e6a7a7265480ca4c817d633da4a1d May 26 12:44:41.751690 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-AttachVolumeShelveTestJSON-282052064-project May 26 12:44:41.751690 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: > May 26 12:44:41.751690 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Instance 7af16d0b-59c7-43ea-856c-ec79029b680c could not be found. May 26 12:44:41.751690 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': '7af16d0b-59c7-43ea-856c-ec79029b680c'} May 26 12:44:41.756493 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:44:41.756493 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:41.756493 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:44:41.756493 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:44:41.756493 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:44:41.756493 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:44:41.756493 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:44:41.756493 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:44:41.756493 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:44:41.756493 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:44:41.756493 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7af16d0b-59c7-43ea-856c-ec79029b680c could not be found. May 26 12:44:41.756493 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:41.756493 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:41.756493 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:41.756493 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:41.756493 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:41.756493 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:41.756493 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:44:41.756493 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:44:41.756493 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:44:41.758112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:44:41.758112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:44:41.758112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:44:41.758112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:44:41.758112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:44:41.758112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:44:41.758112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:44:41.758112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7af16d0b-59c7-43ea-856c-ec79029b680c could not be found. May 26 12:44:41.758112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:41.758112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:41.758112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:41.758112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:41.758112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:41.758112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:41.758112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:44:41.758112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:44:41.758112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7af16d0b-59c7-43ea-856c-ec79029b680c could not be found. May 26 12:44:41.758112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:41.760338 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-8fe060a2-827c-4031-9e91-be6a5c071262 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] Returning 404 to user: Instance 7af16d0b-59c7-43ea-856c-ec79029b680c could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:44:41.760338 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-8fe060a2-827c-4031-9e91-be6a5c071262 tempest-AttachVolumeShelveTestJSON-282052064 tempest-AttachVolumeShelveTestJSON-282052064-project] 10.222.0.39 "GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c" status: 404 len: 111 microversion: 2.20 time: 0.032391 May 26 12:44:41.760338 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 573/1155] 10.222.0.39 () {60 vars in 1276 bytes} [Thu May 26 12:44:41 2022] GET /compute/v2.1/servers/7af16d0b-59c7-43ea-856c-ec79029b680c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 12:44:41.874361 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-be921a6b-c29e-44c0-a3de-01b9327a5689 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:41.895498 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-be921a6b-c29e-44c0-a3de-01b9327a5689 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1757 microversion: 2.1 time: 0.196984 May 26 12:44:41.896075 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 583/1156] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:41 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1757 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:44:42.602026 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f0552749-d924-4fe0-b9e7-e38ca4a9673f tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] Calling method '.version_select at 0x7fed31267af0>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:42.639581 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f0552749-d924-4fe0-b9e7-e38ca4a9673f tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/047ea4f4-c4fd-42bd-8e38-5795a29edd6f" status: 200 len: 287 microversion: 2.1 time: 0.043124 May 26 12:44:42.640445 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 574/1157] 10.222.0.39 () {58 vars in 1250 bytes} [Thu May 26 12:44:42 2022] GET /compute/v2.1/os-snapshots/047ea4f4-c4fd-42bd-8e38-5795a29edd6f => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:42.916278 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-61bb5e57-7cc5-47cc-8236-97f8ae9fa9a5 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:42.917282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-61bb5e57-7cc5-47cc-8236-97f8ae9fa9a5 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:42.928107 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-61bb5e57-7cc5-47cc-8236-97f8ae9fa9a5 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:42.928822 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-61bb5e57-7cc5-47cc-8236-97f8ae9fa9a5 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:42.929886 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-61bb5e57-7cc5-47cc-8236-97f8ae9fa9a5 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:42.931266 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-61bb5e57-7cc5-47cc-8236-97f8ae9fa9a5 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:43.091512 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-61bb5e57-7cc5-47cc-8236-97f8ae9fa9a5 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:43.100637 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-61bb5e57-7cc5-47cc-8236-97f8ae9fa9a5 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1757 microversion: 2.1 time: 0.189762 May 26 12:44:43.111034 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 584/1158] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:42 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1757 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:43.654441 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f8ef32fc-01e3-4948-a8ff-3816b70c2942 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] Calling method '.version_select at 0x7fed31277ca0>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:43.686214 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f8ef32fc-01e3-4948-a8ff-3816b70c2942 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/047ea4f4-c4fd-42bd-8e38-5795a29edd6f" status: 200 len: 287 microversion: 2.1 time: 0.036505 May 26 12:44:43.687050 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 575/1159] 10.222.0.39 () {58 vars in 1250 bytes} [Thu May 26 12:44:43 2022] GET /compute/v2.1/os-snapshots/047ea4f4-c4fd-42bd-8e38-5795a29edd6f => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:44.119568 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-8872beb5-2561-4cc8-8343-0660711e3c26 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:44.120297 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-8872beb5-2561-4cc8-8343-0660711e3c26 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:44.127194 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8872beb5-2561-4cc8-8343-0660711e3c26 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:44.127774 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8872beb5-2561-4cc8-8343-0660711e3c26 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:44.128589 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8872beb5-2561-4cc8-8343-0660711e3c26 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:44.129277 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8872beb5-2561-4cc8-8343-0660711e3c26 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:44.298350 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-8872beb5-2561-4cc8-8343-0660711e3c26 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:44.307218 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-8872beb5-2561-4cc8-8343-0660711e3c26 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1757 microversion: 2.1 time: 0.192770 May 26 12:44:44.307805 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 585/1160] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:44 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1757 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:44.702148 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-bb13516a-22ee-4da9-8bad-d6398dbf4dd1 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] Calling method '.version_select at 0x7fed31595310>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:44.764625 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-bb13516a-22ee-4da9-8bad-d6398dbf4dd1 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/047ea4f4-c4fd-42bd-8e38-5795a29edd6f" status: 200 len: 287 microversion: 2.1 time: 0.069708 May 26 12:44:44.770217 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 576/1161] 10.222.0.39 () {58 vars in 1250 bytes} [Thu May 26 12:44:44 2022] GET /compute/v2.1/os-snapshots/047ea4f4-c4fd-42bd-8e38-5795a29edd6f => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:45.324094 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6c15fd84-b85a-4bc1-8e50-02940e0ee42c tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:45.324834 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-6c15fd84-b85a-4bc1-8e50-02940e0ee42c tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:45.332108 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6c15fd84-b85a-4bc1-8e50-02940e0ee42c tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:45.332912 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6c15fd84-b85a-4bc1-8e50-02940e0ee42c tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:45.333703 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6c15fd84-b85a-4bc1-8e50-02940e0ee42c tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:45.334142 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6c15fd84-b85a-4bc1-8e50-02940e0ee42c tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:45.653271 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-6c15fd84-b85a-4bc1-8e50-02940e0ee42c tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:45.661194 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-6c15fd84-b85a-4bc1-8e50-02940e0ee42c tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1757 microversion: 2.1 time: 0.341600 May 26 12:44:45.661954 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 586/1162] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:45 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1757 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:45.777799 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-b0936aa7-9b25-4713-9764-bb7d937f625b tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] Calling method '.version_select at 0x7fed31267e50>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:45.809291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-b0936aa7-9b25-4713-9764-bb7d937f625b tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/047ea4f4-c4fd-42bd-8e38-5795a29edd6f" status: 200 len: 288 microversion: 2.1 time: 0.035668 May 26 12:44:45.809859 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 577/1163] 10.222.0.39 () {58 vars in 1250 bytes} [Thu May 26 12:44:45 2022] GET /compute/v2.1/os-snapshots/047ea4f4-c4fd-42bd-8e38-5795a29edd6f => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:45.819920 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-aea38bda-1244-4fee-bff5-95b732b746c0 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] Calling method '.version_select at 0x7fed31cacd30>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:45.879436 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-aea38bda-1244-4fee-bff5-95b732b746c0 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] 10.222.0.39 "DELETE /compute/v2.1/os-snapshots/047ea4f4-c4fd-42bd-8e38-5795a29edd6f" status: 202 len: 0 microversion: 2.1 time: 0.062837 May 26 12:44:45.880143 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 587/1164] 10.222.0.39 () {58 vars in 1253 bytes} [Thu May 26 12:44:45 2022] DELETE /compute/v2.1/os-snapshots/047ea4f4-c4fd-42bd-8e38-5795a29edd6f => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:44:45.895637 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-14b4d862-63e5-4a37-b313-ff30f833351f tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] Calling method '.version_select at 0x7fed31277c10>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:45.929278 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-14b4d862-63e5-4a37-b313-ff30f833351f tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/047ea4f4-c4fd-42bd-8e38-5795a29edd6f" status: 200 len: 287 microversion: 2.1 time: 0.037549 May 26 12:44:45.929812 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 578/1165] 10.222.0.39 () {58 vars in 1250 bytes} [Thu May 26 12:44:45 2022] GET /compute/v2.1/os-snapshots/047ea4f4-c4fd-42bd-8e38-5795a29edd6f => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:46.681493 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-ace2fdb6-7ecb-4115-917b-c76c214dd1a7 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:46.683782 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-ace2fdb6-7ecb-4115-917b-c76c214dd1a7 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:46.695129 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ace2fdb6-7ecb-4115-917b-c76c214dd1a7 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:46.696876 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ace2fdb6-7ecb-4115-917b-c76c214dd1a7 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:46.698601 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ace2fdb6-7ecb-4115-917b-c76c214dd1a7 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:46.699111 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-ace2fdb6-7ecb-4115-917b-c76c214dd1a7 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:46.863439 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ace2fdb6-7ecb-4115-917b-c76c214dd1a7 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:46.871701 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-ace2fdb6-7ecb-4115-917b-c76c214dd1a7 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1757 microversion: 2.1 time: 0.196110 May 26 12:44:46.872485 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 588/1166] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:46 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1757 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:46.943572 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-3b6ce0ea-066e-4a7f-9b43-97fc5d1db0f3 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] Calling method '.version_select at 0x7fed31fa9310>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:46.975793 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.wsgi [None req-3b6ce0ea-066e-4a7f-9b43-97fc5d1db0f3 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] HTTP exception thrown: Snapshot 047ea4f4-c4fd-42bd-8e38-5795a29edd6f could not be found. May 26 12:44:46.987412 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-fd11380e-3d15-4e4c-9e05-8f26bb56e50f tempest-VolumesGetTestJSON-1437257963 tempest-VolumesGetTestJSON-1437257963-project] Action: 'create', calling method: .version_select at 0x7fed3134a3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2028877590", "metadata": {"Type": "work"}}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:44:46.990685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-3b6ce0ea-066e-4a7f-9b43-97fc5d1db0f3 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] Request method failure captured: May 26 12:44:46.990685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: request: GET /compute/v2.1/os-snapshots/047ea4f4-c4fd-42bd-8e38-5795a29edd6f HTTP/1.1 May 26 12:44:46.990685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept: application/json May 26 12:44:46.990685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept-Encoding: identity May 26 12:44:46.990685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Connection: close May 26 12:44:46.990685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Length: 0 May 26 12:44:46.990685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Type: application/json May 26 12:44:46.990685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Host: 10.222.0.39 May 26 12:44:46.990685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Openstack-System-Scope: None May 26 12:44:46.990685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: User-Agent: python-urllib3/1.26.9 May 26 12:44:46.990685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Auth-Token: gAAAAABij3Y3z2gYIldGttLuQPCnMQLgN5dTopdHDimYtRibwlF6xUhsWAyZ8TMxHgLoUlkj9JfOWGF520Hs03DF4LXernONGMBZlye0xvxy3qLFs74Md8IPlSSwloG7SE6qmuq5VlRAJMfMqibbtPWVr38XDseArXXABiaaKsWyQW_fSfrLgGk May 26 12:44:46.990685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Id: None May 26 12:44:46.990685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Name: None May 26 12:44:46.990685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Identity-Status: Confirmed May 26 12:44:46.990685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Is-Admin-Project: True May 26 12:44:46.990685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Id: default May 26 12:44:46.990685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Name: Default May 26 12:44:46.990685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Id: ff6b08f53fbc4242be8692da4fdaa9ff May 26 12:44:46.990685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1389880452 May 26 12:44:46.990685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Role: member,reader May 26 12:44:46.990685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Roles: member,reader May 26 12:44:46.992340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ff6b08f53fbc4242be8692da4fdaa9ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ff6b08f53fbc4242be8692da4fdaa9ff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ff6b08f53fbc4242be8692da4fdaa9ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ff6b08f53fbc4242be8692da4fdaa9ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:44:46.992340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1389880452 May 26 12:44:46.992340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Id: ff6b08f53fbc4242be8692da4fdaa9ff May 26 12:44:46.992340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1389880452 May 26 12:44:46.992340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User: tempest-VolumesSnapshotsTestJSON-1389880452-project May 26 12:44:46.992340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Id: default May 26 12:44:46.992340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Name: Default May 26 12:44:46.992340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Id: 11cee8d2384a46899fd18e171c27bdf3 May 26 12:44:46.992340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1389880452-project May 26 12:44:46.992340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: method: May 26 12:44:46.992340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: exception: Snapshot 047ea4f4-c4fd-42bd-8e38-5795a29edd6f could not be found. May 26 12:44:46.992340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: action_args: {'id': '047ea4f4-c4fd-42bd-8e38-5795a29edd6f'} May 26 12:44:46.992340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:44:46.993658 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:46.993658 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 12:44:46.993658 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 12:44:46.993658 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 12:44:46.993658 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 12:44:46.993658 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 12:44:46.993658 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 12:44:46.993658 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:44:46.993658 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:44:46.993658 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:44:46.993658 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:44:46.993658 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:44:46.993658 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:44:46.993658 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:44:46.993658 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:44:46.993658 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 047ea4f4-c4fd-42bd-8e38-5795a29edd6f could not be found. (HTTP 404) (Request-ID: req-f6a7c404-ee07-4ed2-9cae-b7c301dd444e) May 26 12:44:46.993658 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:46.993658 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:46.995347 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:46.995347 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:46.995347 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 26 12:44:46.995347 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 26 12:44:46.995347 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:44:46.995347 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:44:46.995347 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 26 12:44:46.995347 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 26 12:44:46.995347 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:44:46.995347 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:44:46.995347 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 12:44:46.995347 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 12:44:46.995347 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 12:44:46.995347 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 12:44:46.995347 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 12:44:46.995347 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 12:44:46.995347 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:44:46.995347 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:44:46.995347 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:44:46.996514 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:44:46.996514 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:44:46.996514 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:44:46.996514 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:44:46.996514 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:44:46.996514 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 047ea4f4-c4fd-42bd-8e38-5795a29edd6f could not be found. May 26 12:44:46.996514 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:46.996514 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:46.996514 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:46.996514 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:46.996514 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:46.996514 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:46.996514 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:44:46.996514 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:44:46.996514 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:44:46.996514 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:44:46.996514 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:44:46.996514 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:44:46.996514 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 26 12:44:46.996514 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:44:46.998060 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 047ea4f4-c4fd-42bd-8e38-5795a29edd6f could not be found. May 26 12:44:46.998060 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:46.998060 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:46.998060 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:46.998060 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:46.998060 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:46.998060 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:46.998060 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:44:46.998060 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:44:46.998060 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 047ea4f4-c4fd-42bd-8e38-5795a29edd6f could not be found. May 26 12:44:46.998060 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:46.998060 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-3b6ce0ea-066e-4a7f-9b43-97fc5d1db0f3 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] Returning 404 to user: Snapshot 047ea4f4-c4fd-42bd-8e38-5795a29edd6f could not be found. {{(pid=124134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:44:46.998060 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-3b6ce0ea-066e-4a7f-9b43-97fc5d1db0f3 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/047ea4f4-c4fd-42bd-8e38-5795a29edd6f" status: 404 len: 111 microversion: 2.1 time: 0.056383 May 26 12:44:46.999402 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 589/1167] 10.222.0.39 () {58 vars in 1250 bytes} [Thu May 26 12:44:46 2022] GET /compute/v2.1/os-snapshots/047ea4f4-c4fd-42bd-8e38-5795a29edd6f => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:44:47.003631 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-ccf5613e-e848-414b-b3d5-d78b6be2823a tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] Calling method '.version_select at 0x7fed31cd5ee0>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:47.095911 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-ccf5613e-e848-414b-b3d5-d78b6be2823a tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/814bafc1-1c19-415a-ad0a-26c80c767cf4" status: 202 len: 0 microversion: 2.1 time: 0.095805 May 26 12:44:47.097095 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 590/1168] 10.222.0.39 () {58 vars in 1247 bytes} [Thu May 26 12:44:46 2022] DELETE /compute/v2.1/os-volumes/814bafc1-1c19-415a-ad0a-26c80c767cf4 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:44:47.105963 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f7854395-9445-45a7-b0a2-cfbc45a9caf1 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] Calling method '.version_select at 0x7fed31cd54c0>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:47.168159 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-f7854395-9445-45a7-b0a2-cfbc45a9caf1 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/814bafc1-1c19-415a-ad0a-26c80c767cf4" status: 200 len: 345 microversion: 2.1 time: 0.066868 May 26 12:44:47.169123 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 591/1169] 10.222.0.39 () {58 vars in 1244 bytes} [Thu May 26 12:44:47 2022] GET /compute/v2.1/os-volumes/814bafc1-1c19-415a-ad0a-26c80c767cf4 => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:44:47.375090 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-fd11380e-3d15-4e4c-9e05-8f26bb56e50f tempest-VolumesGetTestJSON-1437257963 tempest-VolumesGetTestJSON-1437257963-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.671256 May 26 12:44:47.375753 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 579/1170] 10.222.0.39 () {60 vars in 1155 bytes} [Thu May 26 12:44:46 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 673 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 26 12:44:47.392926 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-89df7630-d3e6-4853-b9d3-70e029836a16 tempest-VolumesGetTestJSON-1437257963 tempest-VolumesGetTestJSON-1437257963-project] Calling method '.version_select at 0x7fed31cacb80>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:47.446953 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-89df7630-d3e6-4853-b9d3-70e029836a16 tempest-VolumesGetTestJSON-1437257963 tempest-VolumesGetTestJSON-1437257963-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/7ba09412-6757-4fff-996d-19a5c6f6f5e9" status: 200 len: 353 microversion: 2.1 time: 0.059599 May 26 12:44:47.447714 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 592/1171] 10.222.0.39 () {58 vars in 1244 bytes} [Thu May 26 12:44:47 2022] GET /compute/v2.1/os-volumes/7ba09412-6757-4fff-996d-19a5c6f6f5e9 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:44:47.889561 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-097f650f-3b32-4884-9eec-b925905bf94f tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:47.890181 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-097f650f-3b32-4884-9eec-b925905bf94f tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:47.898507 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-097f650f-3b32-4884-9eec-b925905bf94f tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:47.899888 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-097f650f-3b32-4884-9eec-b925905bf94f tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:47.903010 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-097f650f-3b32-4884-9eec-b925905bf94f tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:47.903010 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-097f650f-3b32-4884-9eec-b925905bf94f tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:48.050106 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-097f650f-3b32-4884-9eec-b925905bf94f tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:48.052492 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:48.060255 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-097f650f-3b32-4884-9eec-b925905bf94f tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1757 microversion: 2.1 time: 0.174345 May 26 12:44:48.060839 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 580/1172] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:47 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:48.182196 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-0bac5ee3-b2b5-40e0-ad4b-94c26c5f0f2f tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] Calling method '.version_select at 0x7fed32089430>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:48.212519 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.wsgi [None req-0bac5ee3-b2b5-40e0-ad4b-94c26c5f0f2f tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] HTTP exception thrown: Volume 814bafc1-1c19-415a-ad0a-26c80c767cf4 could not be found. May 26 12:44:48.215340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-0bac5ee3-b2b5-40e0-ad4b-94c26c5f0f2f tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] Request method failure captured: May 26 12:44:48.215340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: request: GET /compute/v2.1/os-volumes/814bafc1-1c19-415a-ad0a-26c80c767cf4 HTTP/1.1 May 26 12:44:48.215340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept: application/json May 26 12:44:48.215340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept-Encoding: identity May 26 12:44:48.215340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Connection: close May 26 12:44:48.215340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Length: 0 May 26 12:44:48.215340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Type: application/json May 26 12:44:48.215340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Host: 10.222.0.39 May 26 12:44:48.215340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Openstack-System-Scope: None May 26 12:44:48.215340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: User-Agent: python-urllib3/1.26.9 May 26 12:44:48.215340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Auth-Token: gAAAAABij3Y3z2gYIldGttLuQPCnMQLgN5dTopdHDimYtRibwlF6xUhsWAyZ8TMxHgLoUlkj9JfOWGF520Hs03DF4LXernONGMBZlye0xvxy3qLFs74Md8IPlSSwloG7SE6qmuq5VlRAJMfMqibbtPWVr38XDseArXXABiaaKsWyQW_fSfrLgGk May 26 12:44:48.215340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Id: None May 26 12:44:48.215340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Name: None May 26 12:44:48.215340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Identity-Status: Confirmed May 26 12:44:48.215340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Is-Admin-Project: True May 26 12:44:48.215340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Id: default May 26 12:44:48.215340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Name: Default May 26 12:44:48.215340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Id: ff6b08f53fbc4242be8692da4fdaa9ff May 26 12:44:48.215340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1389880452 May 26 12:44:48.215340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Role: member,reader May 26 12:44:48.215340 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Roles: member,reader May 26 12:44:48.217005 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ff6b08f53fbc4242be8692da4fdaa9ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ff6b08f53fbc4242be8692da4fdaa9ff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ff6b08f53fbc4242be8692da4fdaa9ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ff6b08f53fbc4242be8692da4fdaa9ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:44:48.217005 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1389880452 May 26 12:44:48.217005 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Id: ff6b08f53fbc4242be8692da4fdaa9ff May 26 12:44:48.217005 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1389880452 May 26 12:44:48.217005 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User: tempest-VolumesSnapshotsTestJSON-1389880452-project May 26 12:44:48.217005 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Id: default May 26 12:44:48.217005 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Name: Default May 26 12:44:48.217005 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Id: 11cee8d2384a46899fd18e171c27bdf3 May 26 12:44:48.217005 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1389880452-project May 26 12:44:48.217005 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: method: May 26 12:44:48.217005 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: exception: Volume 814bafc1-1c19-415a-ad0a-26c80c767cf4 could not be found. May 26 12:44:48.217005 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: action_args: {'id': '814bafc1-1c19-415a-ad0a-26c80c767cf4'} May 26 12:44:48.217005 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:44:48.218251 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:48.218251 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:44:48.218251 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:44:48.218251 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:44:48.218251 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:44:48.218251 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:44:48.218251 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:44:48.218251 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:44:48.218251 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:44:48.218251 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:44:48.218251 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:44:48.218251 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:44:48.218251 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:44:48.218251 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:44:48.218251 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:44:48.218251 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 814bafc1-1c19-415a-ad0a-26c80c767cf4 could not be found. (HTTP 404) (Request-ID: req-88a43bc3-0b13-435a-a89f-663c6932897b) May 26 12:44:48.218251 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:48.218251 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:48.218251 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:48.219773 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:48.219773 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 12:44:48.219773 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 12:44:48.219773 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:44:48.219773 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:44:48.219773 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:44:48.219773 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:44:48.219773 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:44:48.219773 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:44:48.219773 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:44:48.219773 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:44:48.219773 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:44:48.219773 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:44:48.219773 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:44:48.219773 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:44:48.219773 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:44:48.219773 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:44:48.219773 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:44:48.219773 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:44:48.221206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:44:48.221206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:44:48.221206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:44:48.221206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:44:48.221206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 814bafc1-1c19-415a-ad0a-26c80c767cf4 could not be found. May 26 12:44:48.221206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:48.221206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:48.221206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:48.221206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:48.221206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:48.221206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:48.221206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:44:48.221206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:44:48.221206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:44:48.221206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:44:48.221206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:44:48.221206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:44:48.221206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 12:44:48.221206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:44:48.222560 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 814bafc1-1c19-415a-ad0a-26c80c767cf4 could not be found. May 26 12:44:48.222560 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:48.222560 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:48.222560 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:48.222560 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:48.222560 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:48.222560 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:48.222560 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:44:48.222560 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:44:48.222560 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 814bafc1-1c19-415a-ad0a-26c80c767cf4 could not be found. May 26 12:44:48.222560 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:48.222560 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-0bac5ee3-b2b5-40e0-ad4b-94c26c5f0f2f tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] Returning 404 to user: Volume 814bafc1-1c19-415a-ad0a-26c80c767cf4 could not be found. {{(pid=124134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:44:48.222560 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-0bac5ee3-b2b5-40e0-ad4b-94c26c5f0f2f tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/814bafc1-1c19-415a-ad0a-26c80c767cf4" status: 404 len: 109 microversion: 2.1 time: 0.039713 May 26 12:44:48.222560 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 593/1173] 10.222.0.39 () {58 vars in 1244 bytes} [Thu May 26 12:44:48 2022] GET /compute/v2.1/os-volumes/814bafc1-1c19-415a-ad0a-26c80c767cf4 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:44:48.233780 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-b045821e-b412-4c71-8f46-da88c0c9ce45 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] Calling method '.version_select at 0x7fed315959d0>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:48.263798 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-b045821e-b412-4c71-8f46-da88c0c9ce45 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] HTTP exception thrown: Volume 814bafc1-1c19-415a-ad0a-26c80c767cf4 could not be found. May 26 12:44:48.265775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-b045821e-b412-4c71-8f46-da88c0c9ce45 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] Request method failure captured: May 26 12:44:48.265775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: DELETE /compute/v2.1/os-volumes/814bafc1-1c19-415a-ad0a-26c80c767cf4 HTTP/1.1 May 26 12:44:48.265775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:44:48.265775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:44:48.265775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:44:48.265775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:44:48.265775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:44:48.265775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:44:48.265775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:44:48.265775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:44:48.265775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3Y3z2gYIldGttLuQPCnMQLgN5dTopdHDimYtRibwlF6xUhsWAyZ8TMxHgLoUlkj9JfOWGF520Hs03DF4LXernONGMBZlye0xvxy3qLFs74Md8IPlSSwloG7SE6qmuq5VlRAJMfMqibbtPWVr38XDseArXXABiaaKsWyQW_fSfrLgGk May 26 12:44:48.265775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:44:48.265775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:44:48.265775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:44:48.265775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:44:48.265775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:44:48.265775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:44:48.265775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: ff6b08f53fbc4242be8692da4fdaa9ff May 26 12:44:48.265775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1389880452 May 26 12:44:48.265775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:44:48.265775 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:44:48.267387 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ff6b08f53fbc4242be8692da4fdaa9ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ff6b08f53fbc4242be8692da4fdaa9ff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ff6b08f53fbc4242be8692da4fdaa9ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ff6b08f53fbc4242be8692da4fdaa9ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:44:48.267387 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1389880452 May 26 12:44:48.267387 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: ff6b08f53fbc4242be8692da4fdaa9ff May 26 12:44:48.267387 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1389880452 May 26 12:44:48.267387 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-VolumesSnapshotsTestJSON-1389880452-project May 26 12:44:48.267387 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:44:48.267387 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:44:48.267387 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: 11cee8d2384a46899fd18e171c27bdf3 May 26 12:44:48.267387 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1389880452-project May 26 12:44:48.267387 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: May 26 12:44:48.267387 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Volume 814bafc1-1c19-415a-ad0a-26c80c767cf4 could not be found. May 26 12:44:48.267387 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': '814bafc1-1c19-415a-ad0a-26c80c767cf4'} May 26 12:44:48.267387 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:44:48.268847 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:48.268847 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:44:48.268847 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:44:48.268847 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 12:44:48.268847 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 12:44:48.268847 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 12:44:48.268847 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 12:44:48.268847 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 12:44:48.268847 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 12:44:48.268847 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 12:44:48.268847 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 12:44:48.268847 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:44:48.268847 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:44:48.268847 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:44:48.268847 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:44:48.268847 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 814bafc1-1c19-415a-ad0a-26c80c767cf4 could not be found. (HTTP 404) (Request-ID: req-026b8119-6b72-4d1a-93a0-0f0e24d7c91f) May 26 12:44:48.268847 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:48.268847 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:48.268847 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:48.270251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:48.270251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 12:44:48.270251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 12:44:48.270251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:44:48.270251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:44:48.270251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:44:48.270251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:44:48.270251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:44:48.270251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:44:48.270251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:44:48.270251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:44:48.270251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 12:44:48.270251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 12:44:48.270251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 12:44:48.270251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 12:44:48.270251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 12:44:48.270251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 12:44:48.270251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 12:44:48.270251 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 12:44:48.271616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:44:48.271616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:44:48.271616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:44:48.271616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:44:48.271616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 814bafc1-1c19-415a-ad0a-26c80c767cf4 could not be found. May 26 12:44:48.271616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:48.271616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:48.271616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:48.271616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:48.271616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:48.271616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:48.271616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:44:48.271616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:44:48.271616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:44:48.271616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:44:48.271616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:44:48.271616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:44:48.271616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 12:44:48.271616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:44:48.273026 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 814bafc1-1c19-415a-ad0a-26c80c767cf4 could not be found. May 26 12:44:48.273026 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:48.273026 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:48.273026 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:48.273026 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:48.273026 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:48.273026 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:48.273026 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:44:48.273026 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:44:48.273026 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 814bafc1-1c19-415a-ad0a-26c80c767cf4 could not be found. May 26 12:44:48.273026 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:44:48.273026 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-b045821e-b412-4c71-8f46-da88c0c9ce45 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] Returning 404 to user: Volume 814bafc1-1c19-415a-ad0a-26c80c767cf4 could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:44:48.273026 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-b045821e-b412-4c71-8f46-da88c0c9ce45 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/814bafc1-1c19-415a-ad0a-26c80c767cf4" status: 404 len: 109 microversion: 2.1 time: 0.037453 May 26 12:44:48.274583 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 581/1174] 10.222.0.39 () {58 vars in 1247 bytes} [Thu May 26 12:44:48 2022] DELETE /compute/v2.1/os-volumes/814bafc1-1c19-415a-ad0a-26c80c767cf4 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:44:48.277443 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-62208bc5-79c7-438a-8c84-97f67cbcae24 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] Calling method '.version_select at 0x7fed31cace50>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:48.306273 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.wsgi [None req-62208bc5-79c7-438a-8c84-97f67cbcae24 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] HTTP exception thrown: Volume 814bafc1-1c19-415a-ad0a-26c80c767cf4 could not be found. May 26 12:44:48.308239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-62208bc5-79c7-438a-8c84-97f67cbcae24 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] Request method failure captured: May 26 12:44:48.308239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: request: GET /compute/v2.1/os-volumes/814bafc1-1c19-415a-ad0a-26c80c767cf4 HTTP/1.1 May 26 12:44:48.308239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept: application/json May 26 12:44:48.308239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept-Encoding: identity May 26 12:44:48.308239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Connection: close May 26 12:44:48.308239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Length: 0 May 26 12:44:48.308239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Type: application/json May 26 12:44:48.308239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Host: 10.222.0.39 May 26 12:44:48.308239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Openstack-System-Scope: None May 26 12:44:48.308239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: User-Agent: python-urllib3/1.26.9 May 26 12:44:48.308239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Auth-Token: gAAAAABij3Y3z2gYIldGttLuQPCnMQLgN5dTopdHDimYtRibwlF6xUhsWAyZ8TMxHgLoUlkj9JfOWGF520Hs03DF4LXernONGMBZlye0xvxy3qLFs74Md8IPlSSwloG7SE6qmuq5VlRAJMfMqibbtPWVr38XDseArXXABiaaKsWyQW_fSfrLgGk May 26 12:44:48.308239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Id: None May 26 12:44:48.308239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Name: None May 26 12:44:48.308239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Identity-Status: Confirmed May 26 12:44:48.308239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Is-Admin-Project: True May 26 12:44:48.308239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Id: default May 26 12:44:48.308239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Name: Default May 26 12:44:48.308239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Id: ff6b08f53fbc4242be8692da4fdaa9ff May 26 12:44:48.308239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1389880452 May 26 12:44:48.308239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Role: member,reader May 26 12:44:48.308239 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Roles: member,reader May 26 12:44:48.309850 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ff6b08f53fbc4242be8692da4fdaa9ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ff6b08f53fbc4242be8692da4fdaa9ff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ff6b08f53fbc4242be8692da4fdaa9ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ff6b08f53fbc4242be8692da4fdaa9ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:44:48.309850 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1389880452 May 26 12:44:48.309850 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Id: ff6b08f53fbc4242be8692da4fdaa9ff May 26 12:44:48.309850 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1389880452 May 26 12:44:48.309850 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User: tempest-VolumesSnapshotsTestJSON-1389880452-project May 26 12:44:48.309850 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Id: default May 26 12:44:48.309850 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Name: Default May 26 12:44:48.309850 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Id: 11cee8d2384a46899fd18e171c27bdf3 May 26 12:44:48.309850 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1389880452-project May 26 12:44:48.309850 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: method: May 26 12:44:48.309850 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: exception: Volume 814bafc1-1c19-415a-ad0a-26c80c767cf4 could not be found. May 26 12:44:48.309850 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: action_args: {'id': '814bafc1-1c19-415a-ad0a-26c80c767cf4'} May 26 12:44:48.309850 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:44:48.311038 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:48.311038 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:44:48.311038 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:44:48.311038 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:44:48.311038 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:44:48.311038 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:44:48.311038 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:44:48.311038 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:44:48.311038 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:44:48.311038 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:44:48.311038 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:44:48.311038 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:44:48.311038 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:44:48.311038 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:44:48.311038 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:44:48.311038 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 814bafc1-1c19-415a-ad0a-26c80c767cf4 could not be found. (HTTP 404) (Request-ID: req-639b87f7-8683-4fc1-8b22-8636f05de3a7) May 26 12:44:48.311038 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:48.311038 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:48.311038 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:48.312492 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:48.312492 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 12:44:48.312492 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 12:44:48.312492 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:44:48.312492 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:44:48.312492 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:44:48.312492 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:44:48.312492 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:44:48.312492 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:44:48.312492 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:44:48.312492 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:44:48.312492 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:44:48.312492 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:44:48.312492 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:44:48.312492 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:44:48.312492 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:44:48.312492 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:44:48.312492 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:44:48.312492 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:44:48.314563 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:44:48.314563 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:44:48.314563 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:44:48.314563 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:44:48.314563 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 814bafc1-1c19-415a-ad0a-26c80c767cf4 could not be found. May 26 12:44:48.314563 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:48.314563 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:48.314563 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:48.314563 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:48.314563 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:48.314563 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:48.314563 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:44:48.314563 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:44:48.314563 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:44:48.314563 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:44:48.314563 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:44:48.314563 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:44:48.314563 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 12:44:48.314563 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:44:48.315970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 814bafc1-1c19-415a-ad0a-26c80c767cf4 could not be found. May 26 12:44:48.315970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:48.315970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:48.315970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:48.315970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:48.315970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:48.315970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:48.315970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:44:48.315970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:44:48.315970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 814bafc1-1c19-415a-ad0a-26c80c767cf4 could not be found. May 26 12:44:48.315970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:48.315970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-62208bc5-79c7-438a-8c84-97f67cbcae24 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] Returning 404 to user: Volume 814bafc1-1c19-415a-ad0a-26c80c767cf4 could not be found. {{(pid=124134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:44:48.315970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-62208bc5-79c7-438a-8c84-97f67cbcae24 tempest-VolumesSnapshotsTestJSON-1389880452 tempest-VolumesSnapshotsTestJSON-1389880452-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/814bafc1-1c19-415a-ad0a-26c80c767cf4" status: 404 len: 109 microversion: 2.1 time: 0.037285 May 26 12:44:48.315970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 594/1175] 10.222.0.39 () {58 vars in 1244 bytes} [Thu May 26 12:44:48 2022] GET /compute/v2.1/os-volumes/814bafc1-1c19-415a-ad0a-26c80c767cf4 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:44:48.459133 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-c8776858-da75-4fb2-bc02-5146d818ba6d tempest-VolumesGetTestJSON-1437257963 tempest-VolumesGetTestJSON-1437257963-project] Calling method '.version_select at 0x7fed3148e4c0>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:48.514263 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-c8776858-da75-4fb2-bc02-5146d818ba6d tempest-VolumesGetTestJSON-1437257963 tempest-VolumesGetTestJSON-1437257963-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/7ba09412-6757-4fff-996d-19a5c6f6f5e9" status: 200 len: 354 microversion: 2.1 time: 0.059052 May 26 12:44:48.515381 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 582/1176] 10.222.0.39 () {58 vars in 1244 bytes} [Thu May 26 12:44:48 2022] GET /compute/v2.1/os-volumes/7ba09412-6757-4fff-996d-19a5c6f6f5e9 => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:48.527376 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-9e679057-b2fa-4d5a-970a-1f7adf1ee399 tempest-VolumesGetTestJSON-1437257963 tempest-VolumesGetTestJSON-1437257963-project] Calling method '.version_select at 0x7fed31cd54c0>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:48.580301 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-9e679057-b2fa-4d5a-970a-1f7adf1ee399 tempest-VolumesGetTestJSON-1437257963 tempest-VolumesGetTestJSON-1437257963-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/7ba09412-6757-4fff-996d-19a5c6f6f5e9" status: 200 len: 354 microversion: 2.1 time: 0.057433 May 26 12:44:48.581017 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 595/1177] 10.222.0.39 () {58 vars in 1244 bytes} [Thu May 26 12:44:48 2022] GET /compute/v2.1/os-volumes/7ba09412-6757-4fff-996d-19a5c6f6f5e9 => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:48.594407 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-7a68a2fb-202c-43fb-97df-cb1e6894165e tempest-VolumesGetTestJSON-1437257963 tempest-VolumesGetTestJSON-1437257963-project] Calling method '.version_select at 0x7fed31277040>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:48.661679 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-7a68a2fb-202c-43fb-97df-cb1e6894165e tempest-VolumesGetTestJSON-1437257963 tempest-VolumesGetTestJSON-1437257963-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/7ba09412-6757-4fff-996d-19a5c6f6f5e9" status: 202 len: 0 microversion: 2.1 time: 0.072187 May 26 12:44:48.662283 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 583/1178] 10.222.0.39 () {58 vars in 1247 bytes} [Thu May 26 12:44:48 2022] DELETE /compute/v2.1/os-volumes/7ba09412-6757-4fff-996d-19a5c6f6f5e9 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:44:48.671148 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-50ef69e4-30c5-435c-b730-34e46fc7ef2e tempest-VolumesGetTestJSON-1437257963 tempest-VolumesGetTestJSON-1437257963-project] Calling method '.version_select at 0x7fed313a8f70>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:48.729706 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-50ef69e4-30c5-435c-b730-34e46fc7ef2e tempest-VolumesGetTestJSON-1437257963 tempest-VolumesGetTestJSON-1437257963-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/7ba09412-6757-4fff-996d-19a5c6f6f5e9" status: 200 len: 353 microversion: 2.1 time: 0.062375 May 26 12:44:48.730557 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 596/1179] 10.222.0.39 () {58 vars in 1244 bytes} [Thu May 26 12:44:48 2022] GET /compute/v2.1/os-volumes/7ba09412-6757-4fff-996d-19a5c6f6f5e9 => generated 353 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:49.078953 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-6bde0b5b-95f0-4fb7-bb98-28e1bf2b5d99 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:49.079573 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-6bde0b5b-95f0-4fb7-bb98-28e1bf2b5d99 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:49.085692 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6bde0b5b-95f0-4fb7-bb98-28e1bf2b5d99 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:49.086138 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6bde0b5b-95f0-4fb7-bb98-28e1bf2b5d99 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:49.087974 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6bde0b5b-95f0-4fb7-bb98-28e1bf2b5d99 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:49.095973 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6bde0b5b-95f0-4fb7-bb98-28e1bf2b5d99 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:49.306893 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-6bde0b5b-95f0-4fb7-bb98-28e1bf2b5d99 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:49.319890 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-6bde0b5b-95f0-4fb7-bb98-28e1bf2b5d99 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1757 microversion: 2.1 time: 0.245678 May 26 12:44:49.321161 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 584/1180] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:49 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1757 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:49.743649 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e5dd111c-0168-48d1-91cf-6ba73ce75a0c tempest-VolumesGetTestJSON-1437257963 tempest-VolumesGetTestJSON-1437257963-project] Calling method '.version_select at 0x7fed31fa9310>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:49.775763 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.wsgi [None req-e5dd111c-0168-48d1-91cf-6ba73ce75a0c tempest-VolumesGetTestJSON-1437257963 tempest-VolumesGetTestJSON-1437257963-project] HTTP exception thrown: Volume 7ba09412-6757-4fff-996d-19a5c6f6f5e9 could not be found. May 26 12:44:49.776946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e5dd111c-0168-48d1-91cf-6ba73ce75a0c tempest-VolumesGetTestJSON-1437257963 tempest-VolumesGetTestJSON-1437257963-project] Request method failure captured: May 26 12:44:49.776946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: request: GET /compute/v2.1/os-volumes/7ba09412-6757-4fff-996d-19a5c6f6f5e9 HTTP/1.1 May 26 12:44:49.776946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept: application/json May 26 12:44:49.776946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept-Encoding: identity May 26 12:44:49.776946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Connection: close May 26 12:44:49.776946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Length: 0 May 26 12:44:49.776946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Type: application/json May 26 12:44:49.776946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Host: 10.222.0.39 May 26 12:44:49.776946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Openstack-System-Scope: None May 26 12:44:49.776946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: User-Agent: python-urllib3/1.26.9 May 26 12:44:49.776946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Auth-Token: gAAAAABij3Y-QLnb5BcLJQzCmRNH4v-Pbqok98rTF1Db4vGhqy5NmHrdHMsYJDKVSQH2DHWaQgMRTTTMNLbPxmm1J7DXSEQ9U-xRxUNfvWVy7hVCNsY4VIYmyjQkYR00KYt_EZzG3HcBlDgSpV-QOGA5Gh7LnuUM4thEbVhUgRVp0Z5MyVHKO14 May 26 12:44:49.776946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Id: None May 26 12:44:49.776946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Name: None May 26 12:44:49.776946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Identity-Status: Confirmed May 26 12:44:49.776946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Is-Admin-Project: True May 26 12:44:49.776946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Id: default May 26 12:44:49.776946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Name: Default May 26 12:44:49.776946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Id: ae3ce3642778456684d1333b2db4f4c1 May 26 12:44:49.776946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Name: tempest-VolumesGetTestJSON-1437257963 May 26 12:44:49.776946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Role: member,reader May 26 12:44:49.776946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Roles: member,reader May 26 12:44:49.778553 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ae3ce3642778456684d1333b2db4f4c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ae3ce3642778456684d1333b2db4f4c1", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ae3ce3642778456684d1333b2db4f4c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ae3ce3642778456684d1333b2db4f4c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:44:49.778553 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant: tempest-VolumesGetTestJSON-1437257963 May 26 12:44:49.778553 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Id: ae3ce3642778456684d1333b2db4f4c1 May 26 12:44:49.778553 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Name: tempest-VolumesGetTestJSON-1437257963 May 26 12:44:49.778553 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User: tempest-VolumesGetTestJSON-1437257963-project May 26 12:44:49.778553 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Id: default May 26 12:44:49.778553 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Name: Default May 26 12:44:49.778553 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Id: a90bae943c614475ad66c7a0fb037cd4 May 26 12:44:49.778553 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Name: tempest-VolumesGetTestJSON-1437257963-project May 26 12:44:49.778553 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: method: May 26 12:44:49.778553 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: exception: Volume 7ba09412-6757-4fff-996d-19a5c6f6f5e9 could not be found. May 26 12:44:49.778553 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: action_args: {'id': '7ba09412-6757-4fff-996d-19a5c6f6f5e9'} May 26 12:44:49.778553 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:44:49.779673 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:49.779673 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:44:49.779673 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:44:49.779673 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:44:49.779673 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:44:49.779673 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:44:49.779673 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:44:49.779673 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:44:49.779673 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:44:49.779673 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:44:49.779673 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:44:49.779673 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:44:49.779673 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:44:49.779673 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:44:49.779673 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:44:49.779673 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7ba09412-6757-4fff-996d-19a5c6f6f5e9 could not be found. (HTTP 404) (Request-ID: req-e7ae50aa-54a7-4e26-a9df-245d1ab8ed38) May 26 12:44:49.779673 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:49.779673 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:49.779673 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:49.781131 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:49.781131 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 12:44:49.781131 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 12:44:49.781131 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:44:49.781131 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:44:49.781131 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:44:49.781131 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:44:49.781131 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:44:49.781131 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:44:49.781131 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:44:49.781131 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:44:49.781131 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:44:49.781131 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:44:49.781131 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:44:49.781131 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:44:49.781131 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:44:49.781131 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:44:49.781131 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:44:49.781131 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:44:49.782500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:44:49.782500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:44:49.782500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:44:49.782500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:44:49.782500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7ba09412-6757-4fff-996d-19a5c6f6f5e9 could not be found. May 26 12:44:49.782500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:49.782500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:49.782500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:49.782500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:49.782500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:49.782500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:49.782500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:44:49.782500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:44:49.782500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:44:49.782500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:44:49.782500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:44:49.782500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:44:49.782500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 12:44:49.782500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:44:49.783970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7ba09412-6757-4fff-996d-19a5c6f6f5e9 could not be found. May 26 12:44:49.783970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:49.783970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:44:49.783970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:49.783970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:44:49.783970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:44:49.783970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:44:49.783970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:44:49.783970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:44:49.783970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7ba09412-6757-4fff-996d-19a5c6f6f5e9 could not be found. May 26 12:44:49.783970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:44:49.783970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e5dd111c-0168-48d1-91cf-6ba73ce75a0c tempest-VolumesGetTestJSON-1437257963 tempest-VolumesGetTestJSON-1437257963-project] Returning 404 to user: Volume 7ba09412-6757-4fff-996d-19a5c6f6f5e9 could not be found. {{(pid=124134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:44:49.783970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-e5dd111c-0168-48d1-91cf-6ba73ce75a0c tempest-VolumesGetTestJSON-1437257963 tempest-VolumesGetTestJSON-1437257963-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/7ba09412-6757-4fff-996d-19a5c6f6f5e9" status: 404 len: 109 microversion: 2.1 time: 0.040481 May 26 12:44:49.783970 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 597/1181] 10.222.0.39 () {58 vars in 1244 bytes} [Thu May 26 12:44:49 2022] GET /compute/v2.1/os-volumes/7ba09412-6757-4fff-996d-19a5c6f6f5e9 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:44:50.338747 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-54ee4a62-9ffe-46a1-98fd-59452c25d70f tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:50.339559 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-54ee4a62-9ffe-46a1-98fd-59452c25d70f tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:50.355388 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-54ee4a62-9ffe-46a1-98fd-59452c25d70f tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:50.355975 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-54ee4a62-9ffe-46a1-98fd-59452c25d70f tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:50.356795 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-54ee4a62-9ffe-46a1-98fd-59452c25d70f tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:50.357413 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-54ee4a62-9ffe-46a1-98fd-59452c25d70f tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:50.549448 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-54ee4a62-9ffe-46a1-98fd-59452c25d70f tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:50.567787 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-54ee4a62-9ffe-46a1-98fd-59452c25d70f tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1757 microversion: 2.1 time: 0.233273 May 26 12:44:50.569134 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 585/1182] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:50 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1757 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:51.588170 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-9bb781d7-ee0e-4f0c-ac47-810e919c129b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:51.588923 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-9bb781d7-ee0e-4f0c-ac47-810e919c129b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:51.597878 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9bb781d7-ee0e-4f0c-ac47-810e919c129b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:51.598655 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9bb781d7-ee0e-4f0c-ac47-810e919c129b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:51.599643 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9bb781d7-ee0e-4f0c-ac47-810e919c129b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:51.600280 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9bb781d7-ee0e-4f0c-ac47-810e919c129b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:51.606087 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=100 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:51.771093 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-9bb781d7-ee0e-4f0c-ac47-810e919c129b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:51.781065 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-9bb781d7-ee0e-4f0c-ac47-810e919c129b tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1757 microversion: 2.1 time: 0.198329 May 26 12:44:51.781752 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 598/1183] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:51 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1757 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:52.799583 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-4e491ca7-3c00-4529-922a-551bfd200ee6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:52.801034 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-4e491ca7-3c00-4529-922a-551bfd200ee6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:52.808902 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4e491ca7-3c00-4529-922a-551bfd200ee6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:52.809548 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4e491ca7-3c00-4529-922a-551bfd200ee6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:52.810890 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4e491ca7-3c00-4529-922a-551bfd200ee6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:52.811645 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4e491ca7-3c00-4529-922a-551bfd200ee6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:52.974358 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-4e491ca7-3c00-4529-922a-551bfd200ee6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:52.983282 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-4e491ca7-3c00-4529-922a-551bfd200ee6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1757 microversion: 2.1 time: 0.187689 May 26 12:44:52.983736 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 586/1184] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:52 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:53.163466 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-60d85188-d295-4c1c-ab0b-d0b4c4d01538 tempest-VolumesTestJSON-1222076781 tempest-VolumesTestJSON-1222076781-project] Calling method '.version_select at 0x7fed31d2b790>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:53.220251 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-60d85188-d295-4c1c-ab0b-d0b4c4d01538 tempest-VolumesTestJSON-1222076781 tempest-VolumesTestJSON-1222076781-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/e3d47d6c-23b4-4489-baa8-9da1fcdd09d1" status: 200 len: 350 microversion: 2.1 time: 0.060323 May 26 12:44:53.221263 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 599/1185] 10.222.0.39 () {58 vars in 1244 bytes} [Thu May 26 12:44:53 2022] GET /compute/v2.1/os-volumes/e3d47d6c-23b4-4489-baa8-9da1fcdd09d1 => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:54.000104 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-26f67e19-3493-46b2-9fe3-e8e6e2425edf tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:54.001584 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-26f67e19-3493-46b2-9fe3-e8e6e2425edf tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:54.004637 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:54.011838 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-26f67e19-3493-46b2-9fe3-e8e6e2425edf tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:54.012375 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-26f67e19-3493-46b2-9fe3-e8e6e2425edf tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:54.013273 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-26f67e19-3493-46b2-9fe3-e8e6e2425edf tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:54.013784 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-26f67e19-3493-46b2-9fe3-e8e6e2425edf tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:54.172859 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-26f67e19-3493-46b2-9fe3-e8e6e2425edf tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:54.181538 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-26f67e19-3493-46b2-9fe3-e8e6e2425edf tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1757 microversion: 2.1 time: 0.185300 May 26 12:44:54.182180 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 587/1186] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:53 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:54.560093 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-4c8ec9d5-1081-4ec7-a6eb-a7df673dbd85 tempest-VolumesTestJSON-1222076781 tempest-VolumesTestJSON-1222076781-project] Calling method '.version_select at 0x7fed31f7b310>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:54.613487 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-4c8ec9d5-1081-4ec7-a6eb-a7df673dbd85 tempest-VolumesTestJSON-1222076781 tempest-VolumesTestJSON-1222076781-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/f54e7627-2715-48c6-bc81-859f6b0d4543" status: 200 len: 350 microversion: 2.1 time: 0.059024 May 26 12:44:54.619194 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 600/1187] 10.222.0.39 () {58 vars in 1244 bytes} [Thu May 26 12:44:54 2022] GET /compute/v2.1/os-volumes/f54e7627-2715-48c6-bc81-859f6b0d4543 => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:55.198813 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d1fb47d1-8d3b-4c5a-95cd-3dff52bd2356 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:55.199517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d1fb47d1-8d3b-4c5a-95cd-3dff52bd2356 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:55.206093 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d1fb47d1-8d3b-4c5a-95cd-3dff52bd2356 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:55.206783 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d1fb47d1-8d3b-4c5a-95cd-3dff52bd2356 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:55.207634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d1fb47d1-8d3b-4c5a-95cd-3dff52bd2356 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:55.208121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d1fb47d1-8d3b-4c5a-95cd-3dff52bd2356 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:55.365681 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-d1fb47d1-8d3b-4c5a-95cd-3dff52bd2356 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:55.375627 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-d1fb47d1-8d3b-4c5a-95cd-3dff52bd2356 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1757 microversion: 2.1 time: 0.181123 May 26 12:44:55.376391 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 588/1188] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:55 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:55.976077 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-966e2852-04c9-4f29-85a1-cd00a406dac9 tempest-VolumesTestJSON-1222076781 tempest-VolumesTestJSON-1222076781-project] Calling method '.version_select at 0x7fed31397af0>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:56.029936 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-966e2852-04c9-4f29-85a1-cd00a406dac9 tempest-VolumesTestJSON-1222076781 tempest-VolumesTestJSON-1222076781-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/93de6df0-1f9f-4fc2-9e20-f489b3430243" status: 200 len: 351 microversion: 2.1 time: 0.058950 May 26 12:44:56.030651 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 601/1189] 10.222.0.39 () {58 vars in 1244 bytes} [Thu May 26 12:44:55 2022] GET /compute/v2.1/os-volumes/93de6df0-1f9f-4fc2-9e20-f489b3430243 => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:56.045948 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-40b496e9-ce11-4e0c-8c26-29f5bc23f1ab tempest-VolumesTestJSON-1222076781 tempest-VolumesTestJSON-1222076781-project] Calling method '.version_select at 0x7fed31531f70>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:56.137193 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-40b496e9-ce11-4e0c-8c26-29f5bc23f1ab tempest-VolumesTestJSON-1222076781 tempest-VolumesTestJSON-1222076781-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.094929 May 26 12:44:56.146039 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 589/1190] 10.222.0.39 () {58 vars in 1133 bytes} [Thu May 26 12:44:56 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:56.151506 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-46991a82-780e-4a76-9935-4373a2e6183b tempest-VolumesTestJSON-1222076781 tempest-VolumesTestJSON-1222076781-project] Calling method '.version_select at 0x7fed31d2b820>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:56.242967 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-46991a82-780e-4a76-9935-4373a2e6183b tempest-VolumesTestJSON-1222076781 tempest-VolumesTestJSON-1222076781-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.095404 May 26 12:44:56.243808 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 602/1191] 10.222.0.39 () {58 vars in 1148 bytes} [Thu May 26 12:44:56 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:56.255348 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-985655f5-bc07-40df-94d5-f3378b9c6338 tempest-VolumesTestJSON-1222076781 tempest-VolumesTestJSON-1222076781-project] Calling method '.version_select at 0x7fed3123f0d0>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:56.385831 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-985655f5-bc07-40df-94d5-f3378b9c6338 tempest-VolumesTestJSON-1222076781 tempest-VolumesTestJSON-1222076781-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.134033 May 26 12:44:56.387165 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 590/1192] 10.222.0.39 () {58 vars in 1133 bytes} [Thu May 26 12:44:56 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:56.400335 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-fd9ee0b7-ac46-446c-a6ba-212fd0c39591 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:56.400826 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-377dbb96-d607-470e-bc84-88b97aa29c0b tempest-VolumesTestJSON-1222076781 tempest-VolumesTestJSON-1222076781-project] Calling method '.version_select at 0x7fed3120e280>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:56.401920 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-fd9ee0b7-ac46-446c-a6ba-212fd0c39591 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:44:56.408291 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:56.410839 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fd9ee0b7-ac46-446c-a6ba-212fd0c39591 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:56.424255 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fd9ee0b7-ac46-446c-a6ba-212fd0c39591 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:56.428464 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fd9ee0b7-ac46-446c-a6ba-212fd0c39591 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:56.429024 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-fd9ee0b7-ac46-446c-a6ba-212fd0c39591 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:56.535973 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-377dbb96-d607-470e-bc84-88b97aa29c0b tempest-VolumesTestJSON-1222076781 tempest-VolumesTestJSON-1222076781-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.139040 May 26 12:44:56.537023 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 591/1193] 10.222.0.39 () {58 vars in 1166 bytes} [Thu May 26 12:44:56 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:56.550119 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-b63b18e2-f644-4b0a-ac86-398861052b7c tempest-VolumesTestJSON-1222076781 tempest-VolumesTestJSON-1222076781-project] Calling method '.version_select at 0x7fed3123fdc0>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:56.662159 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-b63b18e2-f644-4b0a-ac86-398861052b7c tempest-VolumesTestJSON-1222076781 tempest-VolumesTestJSON-1222076781-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.115844 May 26 12:44:56.662935 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 592/1194] 10.222.0.39 () {58 vars in 1169 bytes} [Thu May 26 12:44:56 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:44:56.671752 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-fd9ee0b7-ac46-446c-a6ba-212fd0c39591 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:44:56.675795 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-1eae0d14-ec21-4b95-92ac-7e7e3aced5a2 tempest-VolumesTestJSON-1222076781 tempest-VolumesTestJSON-1222076781-project] Calling method '.version_select at 0x7fed3134a160>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:56.681891 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-fd9ee0b7-ac46-446c-a6ba-212fd0c39591 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1760 microversion: 2.1 time: 0.287058 May 26 12:44:56.682573 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 603/1195] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:44:56 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1760 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:44:56.769253 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-1eae0d14-ec21-4b95-92ac-7e7e3aced5a2 tempest-VolumesTestJSON-1222076781 tempest-VolumesTestJSON-1222076781-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.097121 May 26 12:44:56.770353 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 593/1196] 10.222.0.39 () {58 vars in 1154 bytes} [Thu May 26 12:44:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:44:56.782716 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-5396096b-14e9-44a8-95da-969c716b4f96 tempest-VolumesTestJSON-1222076781 tempest-VolumesTestJSON-1222076781-project] Calling method '.version_select at 0x7fed31d2b9d0>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:56.874137 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-5396096b-14e9-44a8-95da-969c716b4f96 tempest-VolumesTestJSON-1222076781 tempest-VolumesTestJSON-1222076781-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.095235 May 26 12:44:56.875002 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 604/1197] 10.222.0.39 () {58 vars in 1187 bytes} [Thu May 26 12:44:56 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:56.888647 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-3049ed53-eeae-4f2f-a474-71df808309da tempest-VolumesTestJSON-1222076781 tempest-VolumesTestJSON-1222076781-project] Calling method '.version_select at 0x7fed3148e280>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:56.989898 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-3049ed53-eeae-4f2f-a474-71df808309da tempest-VolumesTestJSON-1222076781 tempest-VolumesTestJSON-1222076781-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.106631 May 26 12:44:56.990454 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 594/1198] 10.222.0.39 () {58 vars in 1154 bytes} [Thu May 26 12:44:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:39.976165 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=1 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:39.977532 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=10 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:40.308584 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-af4db38a-d022-4af0-b1d3-1bef33f9bb01 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Action: 'create', calling method: .version_select at 0x7fed313975e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2095207375", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlJ8GwaCVkS59+B2+LLmdoDjnLO1TRblAHD9d6rwhU45jv/fTnkA+tEE4miqUBemw69VFApHgonw31JEsCoBAfX60c1mVdrqeIT5Sbba9HaBVbSamRWxVO8wWZxmMzc9A=="}} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:45:40.336072 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.quota [None req-af4db38a-d022-4af0-b1d3-1bef33f9bb01 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Getting quotas for project 6113ad5a21fa49d6906e26db6cf348a3. Resources: {'key_pairs'} {{(pid=124134) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:45:40.346305 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.quota [None req-af4db38a-d022-4af0-b1d3-1bef33f9bb01 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Getting quotas for user 3c4e48e94f934a3baf6a09a2b2d8f85d and project 6113ad5a21fa49d6906e26db6cf348a3. Resources: {'key_pairs'} {{(pid=124134) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:45:40.372428 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-af4db38a-d022-4af0-b1d3-1bef33f9bb01 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.401832 May 26 12:45:40.373477 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 605/1199] 10.222.0.39 () {60 vars in 1158 bytes} [Thu May 26 12:45:39 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:45:44.079530 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-eebba144-9f43-4f7b-9f15-aae586d3e204 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-780185439", "imageRef": "7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4", "flavorRef": "452", "networks": [{"uuid": "bd3edabd-1e0f-4834-83d9-7eea55ba3e26"}]}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:45:44.087224 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=3 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:44.087882 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=31 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:44.138712 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.network.neutron [None req-eebba144-9f43-4f7b-9f15-aae586d3e204 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] validate_networks() for [('bd3edabd-1e0f-4834-83d9-7eea55ba3e26', None, None, None, None, None)] {{(pid=124133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:45:44.567700 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-eebba144-9f43-4f7b-9f15-aae586d3e204 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Flavor limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:45:44.568118 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-eebba144-9f43-4f7b-9f15-aae586d3e204 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Image limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:45:44.568589 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-eebba144-9f43-4f7b-9f15-aae586d3e204 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Flavor pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:45:44.569045 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-eebba144-9f43-4f7b-9f15-aae586d3e204 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Image pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:45:44.569457 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-eebba144-9f43-4f7b-9f15-aae586d3e204 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:45:44.578696 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-eebba144-9f43-4f7b-9f15-aae586d3e204 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:44.579143 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-eebba144-9f43-4f7b-9f15-aae586d3e204 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:44.579931 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-eebba144-9f43-4f7b-9f15-aae586d3e204 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:44.580364 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-eebba144-9f43-4f7b-9f15-aae586d3e204 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:44.602255 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-eebba144-9f43-4f7b-9f15-aae586d3e204 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Getting quotas for project 967941c42e3046b4b5e929dbc446d2f3. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:45:44.606938 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-eebba144-9f43-4f7b-9f15-aae586d3e204 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Getting quotas for user 7ef548f433e444a2892e772165ce1e11 and project 967941c42e3046b4b5e929dbc446d2f3. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:45:44.617625 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-eebba144-9f43-4f7b-9f15-aae586d3e204 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Going to run 1 instances... {{(pid=124133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:45:44.620029 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-eebba144-9f43-4f7b-9f15-aae586d3e204 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:45:44.667333 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-eebba144-9f43-4f7b-9f15-aae586d3e204 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591486 May 26 12:45:44.668395 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 595/1200] 10.222.0.39 () {60 vars in 1146 bytes} [Thu May 26 12:45:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:45:44.679104 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-aadd576a-09a0-41b1-a1ba-ccbb1438fb9a tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:44.679712 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-aadd576a-09a0-41b1-a1ba-ccbb1438fb9a tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:44.743555 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-aadd576a-09a0-41b1-a1ba-ccbb1438fb9a tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:44.750722 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-aadd576a-09a0-41b1-a1ba-ccbb1438fb9a tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5" status: 200 len: 1218 microversion: 2.1 time: 0.075941 May 26 12:45:44.751298 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 606/1201] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:45:44 2022] GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:45.768116 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-fec5164a-44ce-4c08-a06d-3064f0450d4e tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:45.769090 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-fec5164a-44ce-4c08-a06d-3064f0450d4e tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:45.828971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-fec5164a-44ce-4c08-a06d-3064f0450d4e tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:45.835558 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-fec5164a-44ce-4c08-a06d-3064f0450d4e tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5" status: 200 len: 1218 microversion: 2.1 time: 0.071789 May 26 12:45:45.836117 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 596/1202] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:45:45 2022] GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:45:46.853433 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-af6237b9-e6f3-4c3f-929b-46e5fd79746e tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:46.854043 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-af6237b9-e6f3-4c3f-929b-46e5fd79746e tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:46.920244 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-af6237b9-e6f3-4c3f-929b-46e5fd79746e tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:46.928609 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-af6237b9-e6f3-4c3f-929b-46e5fd79746e tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5" status: 200 len: 1218 microversion: 2.1 time: 0.078952 May 26 12:45:46.929202 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 607/1203] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:45:46 2022] GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:47.945569 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-b9ee75eb-3160-4ab0-95d5-7353e2f44974 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:47.946184 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-b9ee75eb-3160-4ab0-95d5-7353e2f44974 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:48.006856 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-b9ee75eb-3160-4ab0-95d5-7353e2f44974 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:48.014295 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-b9ee75eb-3160-4ab0-95d5-7353e2f44974 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5" status: 200 len: 1218 microversion: 2.1 time: 0.072668 May 26 12:45:48.014877 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 597/1204] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:45:47 2022] GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:49.033806 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-50f56fee-1c80-47f6-9174-93370ef89af1 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:49.034728 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-50f56fee-1c80-47f6-9174-93370ef89af1 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:49.041349 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-50f56fee-1c80-47f6-9174-93370ef89af1 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:49.041794 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-50f56fee-1c80-47f6-9174-93370ef89af1 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:49.042566 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-50f56fee-1c80-47f6-9174-93370ef89af1 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:49.042982 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-50f56fee-1c80-47f6-9174-93370ef89af1 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:49.104297 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-50f56fee-1c80-47f6-9174-93370ef89af1 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:49.112684 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-50f56fee-1c80-47f6-9174-93370ef89af1 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5" status: 200 len: 1222 microversion: 2.1 time: 0.084872 May 26 12:45:49.113336 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 608/1205] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:45:49 2022] GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:50.130033 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-bad0e9c0-1136-413d-b81f-07e93e328c7b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:50.130652 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-bad0e9c0-1136-413d-b81f-07e93e328c7b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:50.137389 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bad0e9c0-1136-413d-b81f-07e93e328c7b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:50.137631 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bad0e9c0-1136-413d-b81f-07e93e328c7b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:50.138409 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bad0e9c0-1136-413d-b81f-07e93e328c7b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:50.138953 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bad0e9c0-1136-413d-b81f-07e93e328c7b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:50.217118 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-bad0e9c0-1136-413d-b81f-07e93e328c7b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:50.225153 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-bad0e9c0-1136-413d-b81f-07e93e328c7b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5" status: 200 len: 1276 microversion: 2.1 time: 0.098931 May 26 12:45:50.225731 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 598/1206] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:45:50 2022] GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 => generated 1276 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:51.243434 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b9ae50d6-1d02-4c3a-954f-7938960c49ba tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:51.244652 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b9ae50d6-1d02-4c3a-954f-7938960c49ba tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:51.251862 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b9ae50d6-1d02-4c3a-954f-7938960c49ba tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:51.252307 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b9ae50d6-1d02-4c3a-954f-7938960c49ba tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:51.253094 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b9ae50d6-1d02-4c3a-954f-7938960c49ba tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:51.253554 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b9ae50d6-1d02-4c3a-954f-7938960c49ba tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:51.432438 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-ad6765c5-1f92-46d5-9469-8643f047468f req-0b34cd02-269c-420a-98a0-23914a2b24d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8188d09d-ca9c-40a9-b5ed-31c897e6b5f5", "tag": "fcda70e8-4784-4b67-a44b-4bbb714c2143"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:45:51.442926 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-ad6765c5-1f92-46d5-9469-8643f047468f req-0b34cd02-269c-420a-98a0-23914a2b24d0 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:51.443539 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-ad6765c5-1f92-46d5-9469-8643f047468f req-0b34cd02-269c-420a-98a0-23914a2b24d0 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:51.457075 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-ad6765c5-1f92-46d5-9469-8643f047468f req-0b34cd02-269c-420a-98a0-23914a2b24d0 service nova] Creating event network-changed:fcda70e8-4784-4b67-a44b-4bbb714c2143 for instance 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 on hv-cinder-81514 May 26 12:45:51.478117 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-ad6765c5-1f92-46d5-9469-8643f047468f req-0b34cd02-269c-420a-98a0-23914a2b24d0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048757 May 26 12:45:51.478858 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 599/1207] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:45:51.485862 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b9ae50d6-1d02-4c3a-954f-7938960c49ba tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:51.499347 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b9ae50d6-1d02-4c3a-954f-7938960c49ba tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5" status: 200 len: 1318 microversion: 2.1 time: 0.260035 May 26 12:45:51.499927 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 609/1208] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:45:51 2022] GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:52.517918 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-52ee848d-0bb7-4e42-b1ad-de2bf1097198 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:52.518615 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-52ee848d-0bb7-4e42-b1ad-de2bf1097198 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:52.525129 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-52ee848d-0bb7-4e42-b1ad-de2bf1097198 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:52.525582 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-52ee848d-0bb7-4e42-b1ad-de2bf1097198 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:52.526346 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-52ee848d-0bb7-4e42-b1ad-de2bf1097198 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:52.526784 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-52ee848d-0bb7-4e42-b1ad-de2bf1097198 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:52.658469 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-52ee848d-0bb7-4e42-b1ad-de2bf1097198 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:52.664966 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-52ee848d-0bb7-4e42-b1ad-de2bf1097198 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5" status: 200 len: 1318 microversion: 2.1 time: 0.152317 May 26 12:45:52.665530 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 600/1209] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:45:52 2022] GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:53.682130 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-304c9041-6391-4f7d-a1e2-62b1cfc6d21b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:53.682741 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-304c9041-6391-4f7d-a1e2-62b1cfc6d21b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:53.689643 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-304c9041-6391-4f7d-a1e2-62b1cfc6d21b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:53.690093 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-304c9041-6391-4f7d-a1e2-62b1cfc6d21b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:53.690844 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-304c9041-6391-4f7d-a1e2-62b1cfc6d21b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:53.691278 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-304c9041-6391-4f7d-a1e2-62b1cfc6d21b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:53.819051 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-304c9041-6391-4f7d-a1e2-62b1cfc6d21b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:53.827642 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-304c9041-6391-4f7d-a1e2-62b1cfc6d21b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5" status: 200 len: 1318 microversion: 2.1 time: 0.148975 May 26 12:45:53.827840 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 610/1210] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:45:53 2022] GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:54.844846 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-fd37ef62-94ba-4ba2-bb22-e653076c6b02 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:54.845451 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-fd37ef62-94ba-4ba2-bb22-e653076c6b02 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:54.847820 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=2 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:54.853347 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fd37ef62-94ba-4ba2-bb22-e653076c6b02 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:54.853794 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fd37ef62-94ba-4ba2-bb22-e653076c6b02 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:54.854552 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fd37ef62-94ba-4ba2-bb22-e653076c6b02 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:54.854984 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fd37ef62-94ba-4ba2-bb22-e653076c6b02 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:54.986392 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-fd37ef62-94ba-4ba2-bb22-e653076c6b02 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:54.993884 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-fd37ef62-94ba-4ba2-bb22-e653076c6b02 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5" status: 200 len: 1318 microversion: 2.1 time: 0.153688 May 26 12:45:54.994445 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 601/1211] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:45:54 2022] GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:45:56.011008 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-9d276e74-26b6-458f-9819-770f9bd4f977 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:56.011532 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-9d276e74-26b6-458f-9819-770f9bd4f977 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:56.021206 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9d276e74-26b6-458f-9819-770f9bd4f977 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:56.021655 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9d276e74-26b6-458f-9819-770f9bd4f977 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:56.022925 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9d276e74-26b6-458f-9819-770f9bd4f977 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:56.023727 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9d276e74-26b6-458f-9819-770f9bd4f977 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:56.426382 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-9d276e74-26b6-458f-9819-770f9bd4f977 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:56.436020 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-9d276e74-26b6-458f-9819-770f9bd4f977 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5" status: 200 len: 1318 microversion: 2.1 time: 0.428158 May 26 12:45:56.436599 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 611/1212] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:45:56 2022] GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:56.565583 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-f2f1395d-afa7-4a49-aa40-f25bbbb4f174 req-579a8b7c-5f1c-458f-bbe4-bf0ffe333a65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8188d09d-ca9c-40a9-b5ed-31c897e6b5f5", "name": "network-vif-plugged", "status": "completed", "tag": "fcda70e8-4784-4b67-a44b-4bbb714c2143"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:45:56.573818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-f2f1395d-afa7-4a49-aa40-f25bbbb4f174 req-579a8b7c-5f1c-458f-bbe4-bf0ffe333a65 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:56.574286 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-f2f1395d-afa7-4a49-aa40-f25bbbb4f174 req-579a8b7c-5f1c-458f-bbe4-bf0ffe333a65 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:56.586174 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-f2f1395d-afa7-4a49-aa40-f25bbbb4f174 req-579a8b7c-5f1c-458f-bbe4-bf0ffe333a65 service nova] Creating event network-vif-plugged:fcda70e8-4784-4b67-a44b-4bbb714c2143 for instance 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 on hv-cinder-81514 May 26 12:45:56.590922 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-f2f1395d-afa7-4a49-aa40-f25bbbb4f174 req-579a8b7c-5f1c-458f-bbe4-bf0ffe333a65 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150132 May 26 12:45:56.593376 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 602/1213] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:45:57.453219 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-c800549f-dda4-46cb-833c-283f6c29e147 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:57.453809 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-c800549f-dda4-46cb-833c-283f6c29e147 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:57.455649 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell0:SELECT=8 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:57.461842 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c800549f-dda4-46cb-833c-283f6c29e147 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:57.462291 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c800549f-dda4-46cb-833c-283f6c29e147 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:57.463108 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c800549f-dda4-46cb-833c-283f6c29e147 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:57.463613 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c800549f-dda4-46cb-833c-283f6c29e147 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:57.593959 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c800549f-dda4-46cb-833c-283f6c29e147 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:57.601334 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-c800549f-dda4-46cb-833c-283f6c29e147 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5" status: 200 len: 1318 microversion: 2.1 time: 0.152397 May 26 12:45:57.601894 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 612/1214] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:45:57 2022] GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:45:58.617942 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=10 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:58.622202 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-355e5843-ad11-4255-9c3c-32d34249179b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:58.623894 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-355e5843-ad11-4255-9c3c-32d34249179b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:58.630922 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-355e5843-ad11-4255-9c3c-32d34249179b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:58.631371 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-355e5843-ad11-4255-9c3c-32d34249179b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:58.632130 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-355e5843-ad11-4255-9c3c-32d34249179b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:58.632568 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-355e5843-ad11-4255-9c3c-32d34249179b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:58.764146 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-355e5843-ad11-4255-9c3c-32d34249179b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:58.771841 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-355e5843-ad11-4255-9c3c-32d34249179b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5" status: 200 len: 1318 microversion: 2.1 time: 0.155351 May 26 12:45:58.772404 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 603/1215] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:45:58 2022] GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:45:59.791080 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-08eed4b1-a5b2-4c70-b6c0-d39393784b7b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:45:59.791901 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-08eed4b1-a5b2-4c70-b6c0-d39393784b7b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:45:59.798965 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-08eed4b1-a5b2-4c70-b6c0-d39393784b7b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:59.799421 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-08eed4b1-a5b2-4c70-b6c0-d39393784b7b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:59.800197 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-08eed4b1-a5b2-4c70-b6c0-d39393784b7b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:59.800641 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-08eed4b1-a5b2-4c70-b6c0-d39393784b7b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:59.940359 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-08eed4b1-a5b2-4c70-b6c0-d39393784b7b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:45:59.948390 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-08eed4b1-a5b2-4c70-b6c0-d39393784b7b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5" status: 200 len: 1507 microversion: 2.1 time: 0.161704 May 26 12:45:59.949083 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 613/1216] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:45:59 2022] GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:46:02.581920 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-5661a636-e8b4-4611-8d6d-7b49f7a34c91 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-921077384"}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:02.582476 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-5661a636-e8b4-4611-8d6d-7b49f7a34c91 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:02.588989 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5661a636-e8b4-4611-8d6d-7b49f7a34c91 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:02.589440 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5661a636-e8b4-4611-8d6d-7b49f7a34c91 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:02.590198 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5661a636-e8b4-4611-8d6d-7b49f7a34c91 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:02.590639 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-5661a636-e8b4-4611-8d6d-7b49f7a34c91 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:02.716291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.network.security_group_api [None req-5661a636-e8b4-4611-8d6d-7b49f7a34c91 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Removing security group 3044dde1-bcac-4f8c-8078-6a0d6bbda0dd from port 3be3d457-3848-425b-9df9-3a6ed2996a1e May 26 12:46:03.111494 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-5661a636-e8b4-4611-8d6d-7b49f7a34c91 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "POST /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9/action" status: 202 len: 0 microversion: 2.1 time: 0.530991 May 26 12:46:03.129087 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-09848160-8cff-45d7-b5b3-e4cfb8602c80 req-07997f43-6a17-4ae7-91e5-f29e5f3f4322 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a15a237-ed0e-403f-812e-805d26cd19b9", "tag": "3be3d457-3848-425b-9df9-3a6ed2996a1e"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:03.135768 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 604/1217] 10.222.0.39 () {60 vars in 1277 bytes} [Thu May 26 12:46:02 2022] POST /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:46:03.142553 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-09848160-8cff-45d7-b5b3-e4cfb8602c80 req-07997f43-6a17-4ae7-91e5-f29e5f3f4322 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:03.142999 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-09848160-8cff-45d7-b5b3-e4cfb8602c80 req-07997f43-6a17-4ae7-91e5-f29e5f3f4322 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:03.156630 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-09848160-8cff-45d7-b5b3-e4cfb8602c80 req-07997f43-6a17-4ae7-91e5-f29e5f3f4322 service nova] Creating event network-changed:3be3d457-3848-425b-9df9-3a6ed2996a1e for instance 1a15a237-ed0e-403f-812e-805d26cd19b9 on hv-cinder-81514 May 26 12:46:03.165113 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-09848160-8cff-45d7-b5b3-e4cfb8602c80 req-07997f43-6a17-4ae7-91e5-f29e5f3f4322 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042183 May 26 12:46:03.166300 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 614/1218] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:04.508231 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-6207305a-30db-44a9-9054-fd948a05ed5d tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:04.508905 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-6207305a-30db-44a9-9054-fd948a05ed5d tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:04.515858 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6207305a-30db-44a9-9054-fd948a05ed5d tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:04.516341 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6207305a-30db-44a9-9054-fd948a05ed5d tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:04.517160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6207305a-30db-44a9-9054-fd948a05ed5d tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:04.517629 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-6207305a-30db-44a9-9054-fd948a05ed5d tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:04.606624 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.objects.instance [None req-6207305a-30db-44a9-9054-fd948a05ed5d tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lazy-loading 'services' on Instance uuid 1a15a237-ed0e-403f-812e-805d26cd19b9 {{(pid=124133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:46:04.683608 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-6207305a-30db-44a9-9054-fd948a05ed5d tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9/os-volume_attachments/05d80f13-c2e9-4a73-8d13-6241995ad167" status: 202 len: 0 microversion: 2.1 time: 0.180066 May 26 12:46:04.684259 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 605/1219] 10.222.0.39 () {58 vars in 1415 bytes} [Thu May 26 12:46:04 2022] DELETE /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9/os-volume_attachments/05d80f13-c2e9-4a73-8d13-6241995ad167 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:46:04.695187 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f302d677-c210-4695-a345-0ee13731cf45 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:04.696065 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-f302d677-c210-4695-a345-0ee13731cf45 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:04.723828 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f302d677-c210-4695-a345-0ee13731cf45 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:04.724228 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f302d677-c210-4695-a345-0ee13731cf45 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:04.725046 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f302d677-c210-4695-a345-0ee13731cf45 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:04.725489 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f302d677-c210-4695-a345-0ee13731cf45 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:04.760921 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-f302d677-c210-4695-a345-0ee13731cf45 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070621 May 26 12:46:04.761502 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 615/1220] 10.222.0.39 () {58 vars in 1301 bytes} [Thu May 26 12:46:04 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:05.182110 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-9d59db12-8780-4a86-8855-e30216468115 req-ed63fda9-a566-43d6-b40f-44eec082392f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a15a237-ed0e-403f-812e-805d26cd19b9", "tag": "3be3d457-3848-425b-9df9-3a6ed2996a1e"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:05.191134 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-9d59db12-8780-4a86-8855-e30216468115 req-ed63fda9-a566-43d6-b40f-44eec082392f service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:05.191625 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-9d59db12-8780-4a86-8855-e30216468115 req-ed63fda9-a566-43d6-b40f-44eec082392f service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:05.203813 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-9d59db12-8780-4a86-8855-e30216468115 req-ed63fda9-a566-43d6-b40f-44eec082392f service nova] Creating event network-changed:3be3d457-3848-425b-9df9-3a6ed2996a1e for instance 1a15a237-ed0e-403f-812e-805d26cd19b9 on hv-cinder-81514 May 26 12:46:05.208890 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-9d59db12-8780-4a86-8855-e30216468115 req-ed63fda9-a566-43d6-b40f-44eec082392f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030814 May 26 12:46:05.209523 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 606/1221] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:05.774763 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-119ee2d0-e453-4aa9-9fcd-f2bd2c071417 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:05.775680 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-119ee2d0-e453-4aa9-9fcd-f2bd2c071417 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:05.782479 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-119ee2d0-e453-4aa9-9fcd-f2bd2c071417 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:05.782934 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-119ee2d0-e453-4aa9-9fcd-f2bd2c071417 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:05.783689 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-119ee2d0-e453-4aa9-9fcd-f2bd2c071417 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:05.784208 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-119ee2d0-e453-4aa9-9fcd-f2bd2c071417 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:05.816374 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-119ee2d0-e453-4aa9-9fcd-f2bd2c071417 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045770 May 26 12:46:05.816978 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 616/1222] 10.222.0.39 () {58 vars in 1301 bytes} [Thu May 26 12:46:05 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:06.829600 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-0a37b2a4-5aca-4dd5-8dac-5dfa44b5c397 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:06.830529 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-0a37b2a4-5aca-4dd5-8dac-5dfa44b5c397 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:06.836799 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0a37b2a4-5aca-4dd5-8dac-5dfa44b5c397 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:06.837245 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0a37b2a4-5aca-4dd5-8dac-5dfa44b5c397 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:06.838005 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0a37b2a4-5aca-4dd5-8dac-5dfa44b5c397 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:06.838460 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0a37b2a4-5aca-4dd5-8dac-5dfa44b5c397 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:06.870179 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-0a37b2a4-5aca-4dd5-8dac-5dfa44b5c397 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045776 May 26 12:46:06.870906 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 607/1223] 10.222.0.39 () {58 vars in 1301 bytes} [Thu May 26 12:46:06 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:46:06.881530 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-690ba2d0-a17a-4c9a-8b40-aaf2e259a8f6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:06.882232 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-690ba2d0-a17a-4c9a-8b40-aaf2e259a8f6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:06.888658 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-690ba2d0-a17a-4c9a-8b40-aaf2e259a8f6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:06.889824 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-690ba2d0-a17a-4c9a-8b40-aaf2e259a8f6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:06.890846 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-690ba2d0-a17a-4c9a-8b40-aaf2e259a8f6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:06.891282 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-690ba2d0-a17a-4c9a-8b40-aaf2e259a8f6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:06.971494 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.wsgi [None req-690ba2d0-a17a-4c9a-8b40-aaf2e259a8f6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] HTTP exception thrown: Instance 1a15a237-ed0e-403f-812e-805d26cd19b9 is not attached to volume 05d80f13-c2e9-4a73-8d13-6241995ad167 May 26 12:46:06.978091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-690ba2d0-a17a-4c9a-8b40-aaf2e259a8f6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Request method failure captured: May 26 12:46:06.978091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: request: DELETE /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9/os-volume_attachments/05d80f13-c2e9-4a73-8d13-6241995ad167 HTTP/1.1 May 26 12:46:06.978091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept: application/json May 26 12:46:06.978091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept-Encoding: identity May 26 12:46:06.978091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Connection: close May 26 12:46:06.978091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Length: 0 May 26 12:46:06.978091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Type: application/json May 26 12:46:06.978091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Host: 10.222.0.39 May 26 12:46:06.978091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Openstack-System-Scope: None May 26 12:46:06.978091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: User-Agent: python-urllib3/1.26.9 May 26 12:46:06.978091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Auth-Token: gAAAAABij3WmZrlGB8YvMedLIqndZtvGcm2ZZDEND9ZH0wRDzfLFq9-YXQ_-3Oqyp4YE98RuZGS5XyKjQS-P4o_67zSyNbmO_R03ApUSuha75Nc2JG_q-_NhseT594cFfnBQLK0LHsZVzaI9Ol_T15eRhPIiHOfMmEZR7EQaNljrXUtIM3CQ6N4 May 26 12:46:06.978091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Id: None May 26 12:46:06.978091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Name: None May 26 12:46:06.978091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Identity-Status: Confirmed May 26 12:46:06.978091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Is-Admin-Project: True May 26 12:46:06.978091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Id: default May 26 12:46:06.978091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Name: Default May 26 12:46:06.978091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Id: 91ce6c14fb95466dab6338cd0fafcd0e May 26 12:46:06.978091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Name: tempest-TestMinimumBasicScenario-468943314 May 26 12:46:06.978091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Role: member,reader May 26 12:46:06.978091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Roles: member,reader May 26 12:46:06.979903 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91ce6c14fb95466dab6338cd0fafcd0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_91ce6c14fb95466dab6338cd0fafcd0e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91ce6c14fb95466dab6338cd0fafcd0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/91ce6c14fb95466dab6338cd0fafcd0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:46:06.979903 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant: tempest-TestMinimumBasicScenario-468943314 May 26 12:46:06.979903 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Id: 91ce6c14fb95466dab6338cd0fafcd0e May 26 12:46:06.979903 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Name: tempest-TestMinimumBasicScenario-468943314 May 26 12:46:06.979903 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User: tempest-TestMinimumBasicScenario-468943314-project May 26 12:46:06.979903 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Id: default May 26 12:46:06.979903 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Name: Default May 26 12:46:06.979903 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Id: 7ff0a10504ef4323a853d5f721c05299 May 26 12:46:06.979903 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Name: tempest-TestMinimumBasicScenario-468943314-project May 26 12:46:06.979903 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: method: > May 26 12:46:06.979903 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: exception: Instance 1a15a237-ed0e-403f-812e-805d26cd19b9 is not attached to volume 05d80f13-c2e9-4a73-8d13-6241995ad167 May 26 12:46:06.980866 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: action_args: {'server_id': '1a15a237-ed0e-403f-812e-805d26cd19b9', 'id': '05d80f13-c2e9-4a73-8d13-6241995ad167'} May 26 12:46:06.980866 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:46:06.980866 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:06.980866 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 26 12:46:06.980866 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 26 12:46:06.980866 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:46:06.980866 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:46:06.980866 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 26 12:46:06.980866 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 26 12:46:06.980866 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 05d80f13-c2e9-4a73-8d13-6241995ad167. May 26 12:46:06.980866 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:46:06.980866 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:46:06.980866 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:46:06.980866 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:06.980866 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:46:06.980866 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:46:06.980866 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:46:06.980866 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:46:06.980866 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:46:06.982420 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:46:06.982420 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 26 12:46:06.982420 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 26 12:46:06.982420 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a15a237-ed0e-403f-812e-805d26cd19b9 is not attached to volume 05d80f13-c2e9-4a73-8d13-6241995ad167 May 26 12:46:06.982420 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:46:06.982420 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:46:06.982420 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:46:06.982420 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:06.982420 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:46:06.982420 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:46:06.982420 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:46:06.982420 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:46:06.982420 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a15a237-ed0e-403f-812e-805d26cd19b9 is not attached to volume 05d80f13-c2e9-4a73-8d13-6241995ad167 May 26 12:46:06.982420 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:46:06.982420 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-690ba2d0-a17a-4c9a-8b40-aaf2e259a8f6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Returning 404 to user: Instance 1a15a237-ed0e-403f-812e-805d26cd19b9 is not attached to volume 05d80f13-c2e9-4a73-8d13-6241995ad167 {{(pid=124134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:46:06.983882 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-690ba2d0-a17a-4c9a-8b40-aaf2e259a8f6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9/os-volume_attachments/05d80f13-c2e9-4a73-8d13-6241995ad167" status: 404 len: 154 microversion: 2.1 time: 0.102213 May 26 12:46:06.983882 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 617/1224] 10.222.0.39 () {58 vars in 1415 bytes} [Thu May 26 12:46:06 2022] DELETE /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9/os-volume_attachments/05d80f13-c2e9-4a73-8d13-6241995ad167 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:46:07.489725 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-dabc1e3f-9ce1-4c53-b056-67ec55ceb000 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-270246607", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2095207375", "security_groups": [{"name": "tempest-secgroup-smoke-2046651539"}], "block_device_mapping_v2": [{"uuid": "caf79859-107c-41c3-8a4a-d9e4a9c7c7f3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cf1be97e-5e69-46c0-98a3-21a4f70a519f"}]}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:07.608834 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.network.neutron [None req-dabc1e3f-9ce1-4c53-b056-67ec55ceb000 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] validate_networks() for [('cf1be97e-5e69-46c0-98a3-21a4f70a519f', None, None, None, None, None)] {{(pid=124133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:46:07.985675 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-dabc1e3f-9ce1-4c53-b056-67ec55ceb000 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Flavor limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:46:07.986303 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-dabc1e3f-9ce1-4c53-b056-67ec55ceb000 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Image limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:46:07.986556 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-dabc1e3f-9ce1-4c53-b056-67ec55ceb000 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Flavor pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:46:07.986961 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-dabc1e3f-9ce1-4c53-b056-67ec55ceb000 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Image pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:46:07.987368 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-dabc1e3f-9ce1-4c53-b056-67ec55ceb000 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:46:07.997075 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dabc1e3f-9ce1-4c53-b056-67ec55ceb000 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:07.997517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dabc1e3f-9ce1-4c53-b056-67ec55ceb000 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:07.998339 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dabc1e3f-9ce1-4c53-b056-67ec55ceb000 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:07.999268 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dabc1e3f-9ce1-4c53-b056-67ec55ceb000 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:08.016222 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-dabc1e3f-9ce1-4c53-b056-67ec55ceb000 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Getting quotas for project 6113ad5a21fa49d6906e26db6cf348a3. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:46:08.022153 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-dabc1e3f-9ce1-4c53-b056-67ec55ceb000 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Getting quotas for user 3c4e48e94f934a3baf6a09a2b2d8f85d and project 6113ad5a21fa49d6906e26db6cf348a3. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:46:08.083744 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-dabc1e3f-9ce1-4c53-b056-67ec55ceb000 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Going to run 1 instances... {{(pid=124133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:46:08.085904 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-dabc1e3f-9ce1-4c53-b056-67ec55ceb000 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='caf79859-107c-41c3-8a4a-d9e4a9c7c7f3',volume_size=None,volume_type=None)] {{(pid=124133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:46:08.119110 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-af08f5d3-ac95-42e9-9e55-0dfdf9025a8a tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:08.119872 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-af08f5d3-ac95-42e9-9e55-0dfdf9025a8a tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:08.129870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-af08f5d3-ac95-42e9-9e55-0dfdf9025a8a tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:08.130328 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-af08f5d3-ac95-42e9-9e55-0dfdf9025a8a tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:08.131671 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-af08f5d3-ac95-42e9-9e55-0dfdf9025a8a tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:08.131671 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-af08f5d3-ac95-42e9-9e55-0dfdf9025a8a tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:08.159507 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-af08f5d3-ac95-42e9-9e55-0dfdf9025a8a tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Going to try to terminate instance {{(pid=124134) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:46:08.230782 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-dabc1e3f-9ce1-4c53-b056-67ec55ceb000 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.744881 May 26 12:46:08.231727 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 608/1225] 10.222.0.39 () {60 vars in 1146 bytes} [Thu May 26 12:46:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:46:08.242967 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-af08f5d3-ac95-42e9-9e55-0dfdf9025a8a tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 204 len: 0 microversion: 2.1 time: 0.128544 May 26 12:46:08.243862 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 618/1226] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:46:08 2022] DELETE /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 12:46:08.247413 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-5e508262-1e1a-4ada-8339-0ec90e6e5fdf tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:08.248094 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-5e508262-1e1a-4ada-8339-0ec90e6e5fdf tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:08.255123 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-990fb57b-4044-432b-ad56-fe70f5e1a650 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:08.255847 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-990fb57b-4044-432b-ad56-fe70f5e1a650 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:08.262354 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-990fb57b-4044-432b-ad56-fe70f5e1a650 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:08.263061 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-990fb57b-4044-432b-ad56-fe70f5e1a650 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:08.264031 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-990fb57b-4044-432b-ad56-fe70f5e1a650 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:08.264651 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-990fb57b-4044-432b-ad56-fe70f5e1a650 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:08.308028 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-5e508262-1e1a-4ada-8339-0ec90e6e5fdf tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:08.315662 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-5e508262-1e1a-4ada-8339-0ec90e6e5fdf tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 200 len: 1094 microversion: 2.1 time: 0.077125 May 26 12:46:08.316240 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 609/1227] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:46:08 2022] GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:08.405462 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-990fb57b-4044-432b-ad56-fe70f5e1a650 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:08.413083 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-990fb57b-4044-432b-ad56-fe70f5e1a650 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1555 microversion: 2.1 time: 0.164603 May 26 12:46:08.413647 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 619/1228] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:46:08 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:46:09.335895 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-eb31d939-1b5f-4258-855b-ab4c2cb72124 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:09.336645 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-eb31d939-1b5f-4258-855b-ab4c2cb72124 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:09.389033 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-eb31d939-1b5f-4258-855b-ab4c2cb72124 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:09.397103 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-eb31d939-1b5f-4258-855b-ab4c2cb72124 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 200 len: 1094 microversion: 2.1 time: 0.067796 May 26 12:46:09.397895 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 610/1229] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:46:09 2022] GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:09.431122 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-58a0f2c1-3942-4ef2-942f-0e04d1982c99 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:09.431725 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-58a0f2c1-3942-4ef2-942f-0e04d1982c99 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:09.439379 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-58a0f2c1-3942-4ef2-942f-0e04d1982c99 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:09.439833 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-58a0f2c1-3942-4ef2-942f-0e04d1982c99 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:09.440676 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-58a0f2c1-3942-4ef2-942f-0e04d1982c99 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:09.441085 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-58a0f2c1-3942-4ef2-942f-0e04d1982c99 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:09.586628 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-58a0f2c1-3942-4ef2-942f-0e04d1982c99 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:09.594999 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-58a0f2c1-3942-4ef2-942f-0e04d1982c99 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1555 microversion: 2.1 time: 0.167919 May 26 12:46:09.595618 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 620/1230] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:46:09 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:10.414527 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-1be94df9-ccfe-490f-9f28-056efaf64e10 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:10.415132 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-1be94df9-ccfe-490f-9f28-056efaf64e10 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:10.422220 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1be94df9-ccfe-490f-9f28-056efaf64e10 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:10.422685 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1be94df9-ccfe-490f-9f28-056efaf64e10 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:10.423450 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1be94df9-ccfe-490f-9f28-056efaf64e10 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:10.423919 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1be94df9-ccfe-490f-9f28-056efaf64e10 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:10.486305 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-1be94df9-ccfe-490f-9f28-056efaf64e10 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:10.493670 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-1be94df9-ccfe-490f-9f28-056efaf64e10 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 200 len: 1144 microversion: 2.1 time: 0.083256 May 26 12:46:10.494227 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 611/1231] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:46:10 2022] GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:10.612420 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-7369c7a4-f709-4f19-8c41-fc900565f979 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:10.613043 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-7369c7a4-f709-4f19-8c41-fc900565f979 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:10.615478 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:10.620667 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7369c7a4-f709-4f19-8c41-fc900565f979 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:10.621140 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7369c7a4-f709-4f19-8c41-fc900565f979 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:10.621892 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7369c7a4-f709-4f19-8c41-fc900565f979 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:10.622323 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7369c7a4-f709-4f19-8c41-fc900565f979 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:10.627902 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:10.765781 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-7369c7a4-f709-4f19-8c41-fc900565f979 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:10.774683 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-7369c7a4-f709-4f19-8c41-fc900565f979 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1555 microversion: 2.1 time: 0.166851 May 26 12:46:10.775318 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 621/1232] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:46:10 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:11.510853 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e375d441-3223-400f-ada8-006be5562cba tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:11.511448 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e375d441-3223-400f-ada8-006be5562cba tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:11.518641 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e375d441-3223-400f-ada8-006be5562cba tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:11.519086 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e375d441-3223-400f-ada8-006be5562cba tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:11.519843 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e375d441-3223-400f-ada8-006be5562cba tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:11.520535 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e375d441-3223-400f-ada8-006be5562cba tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:11.586038 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e375d441-3223-400f-ada8-006be5562cba tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:11.594191 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e375d441-3223-400f-ada8-006be5562cba tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 200 len: 1192 microversion: 2.1 time: 0.086524 May 26 12:46:11.594913 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 612/1233] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:46:11 2022] GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 1192 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:11.793081 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-227a6775-5dae-440b-bdad-370509ed947e tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:11.793651 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-227a6775-5dae-440b-bdad-370509ed947e tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:11.800476 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-227a6775-5dae-440b-bdad-370509ed947e tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:11.800966 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-227a6775-5dae-440b-bdad-370509ed947e tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:11.801730 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-227a6775-5dae-440b-bdad-370509ed947e tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:11.802168 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-227a6775-5dae-440b-bdad-370509ed947e tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:11.934969 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-227a6775-5dae-440b-bdad-370509ed947e tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:11.943855 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-227a6775-5dae-440b-bdad-370509ed947e tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1555 microversion: 2.1 time: 0.154722 May 26 12:46:11.944797 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 622/1234] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:46:11 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:12.457974 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-2d3c8660-4532-4cdf-8b2a-b779797627bb req-9a8ae0ed-4502-4d24-a8c5-450d18fe6fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a15a237-ed0e-403f-812e-805d26cd19b9", "name": "network-vif-deleted", "tag": "3be3d457-3848-425b-9df9-3a6ed2996a1e"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:12.466356 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-2d3c8660-4532-4cdf-8b2a-b779797627bb req-9a8ae0ed-4502-4d24-a8c5-450d18fe6fd2 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:12.466821 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-2d3c8660-4532-4cdf-8b2a-b779797627bb req-9a8ae0ed-4502-4d24-a8c5-450d18fe6fd2 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:12.478183 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-2d3c8660-4532-4cdf-8b2a-b779797627bb req-9a8ae0ed-4502-4d24-a8c5-450d18fe6fd2 service nova] Creating event network-vif-deleted:3be3d457-3848-425b-9df9-3a6ed2996a1e for instance 1a15a237-ed0e-403f-812e-805d26cd19b9 on hv-cinder-81514 May 26 12:46:12.483451 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-2d3c8660-4532-4cdf-8b2a-b779797627bb req-9a8ae0ed-4502-4d24-a8c5-450d18fe6fd2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029906 May 26 12:46:12.487703 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 613/1235] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:12.612280 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-d22ee532-513f-4d8a-a8c2-dfc1c6753425 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:12.612881 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-d22ee532-513f-4d8a-a8c2-dfc1c6753425 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:12.619342 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d22ee532-513f-4d8a-a8c2-dfc1c6753425 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:12.619800 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d22ee532-513f-4d8a-a8c2-dfc1c6753425 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:12.620582 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d22ee532-513f-4d8a-a8c2-dfc1c6753425 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:12.621057 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d22ee532-513f-4d8a-a8c2-dfc1c6753425 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:12.688045 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d22ee532-513f-4d8a-a8c2-dfc1c6753425 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:12.695813 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-d22ee532-513f-4d8a-a8c2-dfc1c6753425 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 200 len: 1210 microversion: 2.1 time: 0.088429 May 26 12:46:12.705344 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 623/1236] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:46:12 2022] GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:12.963120 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f0015917-f6c9-492e-af4d-4c8f2cf0df8d tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:12.963828 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f0015917-f6c9-492e-af4d-4c8f2cf0df8d tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:12.971539 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f0015917-f6c9-492e-af4d-4c8f2cf0df8d tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:12.972176 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f0015917-f6c9-492e-af4d-4c8f2cf0df8d tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:12.972882 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f0015917-f6c9-492e-af4d-4c8f2cf0df8d tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:12.973357 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f0015917-f6c9-492e-af4d-4c8f2cf0df8d tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:13.012376 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f0015917-f6c9-492e-af4d-4c8f2cf0df8d tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:13.013095 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f0015917-f6c9-492e-af4d-4c8f2cf0df8d tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:13.013645 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.objects.instance [None req-f0015917-f6c9-492e-af4d-4c8f2cf0df8d tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lazy-loading 'fault' on Instance uuid 1a15a237-ed0e-403f-812e-805d26cd19b9 {{(pid=124133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:46:13.062019 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f0015917-f6c9-492e-af4d-4c8f2cf0df8d tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0a10504ef4323a853d5f721c05299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ce6c14fb95466dab6338cd0fafcd0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:13.072220 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f0015917-f6c9-492e-af4d-4c8f2cf0df8d tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 200 len: 1348 microversion: 2.1 time: 0.113715 May 26 12:46:13.073552 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 614/1237] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:46:12 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 1348 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:13.712428 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-1ec32dde-6dbf-49b1-a6a7-aef8651e43a2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:13.713370 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-1ec32dde-6dbf-49b1-a6a7-aef8651e43a2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:13.720860 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1ec32dde-6dbf-49b1-a6a7-aef8651e43a2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:13.721384 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1ec32dde-6dbf-49b1-a6a7-aef8651e43a2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:13.722155 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1ec32dde-6dbf-49b1-a6a7-aef8651e43a2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:13.722676 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-1ec32dde-6dbf-49b1-a6a7-aef8651e43a2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:13.789855 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-aeffb3b6-b1be-4de0-81e2-dd2b1b166e59 req-1cb0f2cf-44c8-4014-be2e-1a04543309ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a48ffb19-6386-4b90-93f7-16e01c3060da", "tag": "adabefab-e666-411d-95db-a8e377570585"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:13.802210 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-aeffb3b6-b1be-4de0-81e2-dd2b1b166e59 req-1cb0f2cf-44c8-4014-be2e-1a04543309ef service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:13.802484 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-aeffb3b6-b1be-4de0-81e2-dd2b1b166e59 req-1cb0f2cf-44c8-4014-be2e-1a04543309ef service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:13.820961 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-aeffb3b6-b1be-4de0-81e2-dd2b1b166e59 req-1cb0f2cf-44c8-4014-be2e-1a04543309ef service nova] Creating event network-changed:adabefab-e666-411d-95db-a8e377570585 for instance a48ffb19-6386-4b90-93f7-16e01c3060da on hv-cinder-81514 May 26 12:46:13.826000 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-aeffb3b6-b1be-4de0-81e2-dd2b1b166e59 req-1cb0f2cf-44c8-4014-be2e-1a04543309ef service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039781 May 26 12:46:13.826606 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 615/1238] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:13.912685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-1ec32dde-6dbf-49b1-a6a7-aef8651e43a2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:13.922203 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-1ec32dde-6dbf-49b1-a6a7-aef8651e43a2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 200 len: 1266 microversion: 2.1 time: 0.212585 May 26 12:46:13.923144 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 624/1239] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:46:13 2022] GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:46:14.091611 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-71ecbe4a-cf3c-4cdf-aeca-20893b36a2d3 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:14.093134 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-71ecbe4a-cf3c-4cdf-aeca-20893b36a2d3 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] [instance: 1a15a237-ed0e-403f-812e-805d26cd19b9] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:14.096220 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:14.105646 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-71ecbe4a-cf3c-4cdf-aeca-20893b36a2d3 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:14.106104 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-71ecbe4a-cf3c-4cdf-aeca-20893b36a2d3 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:14.106892 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-71ecbe4a-cf3c-4cdf-aeca-20893b36a2d3 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:14.107340 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-71ecbe4a-cf3c-4cdf-aeca-20893b36a2d3 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:14.113630 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:14.124199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-71ecbe4a-cf3c-4cdf-aeca-20893b36a2d3 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] HTTP exception thrown: Instance 1a15a237-ed0e-403f-812e-805d26cd19b9 could not be found. May 26 12:46:14.126086 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-71ecbe4a-cf3c-4cdf-aeca-20893b36a2d3 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Request method failure captured: May 26 12:46:14.126086 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 HTTP/1.1 May 26 12:46:14.126086 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:46:14.126086 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:46:14.126086 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:46:14.126086 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:46:14.126086 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:46:14.126086 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:46:14.126086 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:46:14.126086 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:46:14.126086 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3WmZrlGB8YvMedLIqndZtvGcm2ZZDEND9ZH0wRDzfLFq9-YXQ_-3Oqyp4YE98RuZGS5XyKjQS-P4o_67zSyNbmO_R03ApUSuha75Nc2JG_q-_NhseT594cFfnBQLK0LHsZVzaI9Ol_T15eRhPIiHOfMmEZR7EQaNljrXUtIM3CQ6N4 May 26 12:46:14.126086 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:46:14.126086 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:46:14.126086 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:46:14.126086 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:46:14.126086 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:46:14.126086 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:46:14.126086 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: 91ce6c14fb95466dab6338cd0fafcd0e May 26 12:46:14.126086 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-TestMinimumBasicScenario-468943314 May 26 12:46:14.126086 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:46:14.126086 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:46:14.127771 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91ce6c14fb95466dab6338cd0fafcd0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_91ce6c14fb95466dab6338cd0fafcd0e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/91ce6c14fb95466dab6338cd0fafcd0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/91ce6c14fb95466dab6338cd0fafcd0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:46:14.127771 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-TestMinimumBasicScenario-468943314 May 26 12:46:14.127771 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: 91ce6c14fb95466dab6338cd0fafcd0e May 26 12:46:14.127771 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-TestMinimumBasicScenario-468943314 May 26 12:46:14.127771 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-TestMinimumBasicScenario-468943314-project May 26 12:46:14.127771 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:46:14.127771 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:46:14.127771 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: 7ff0a10504ef4323a853d5f721c05299 May 26 12:46:14.127771 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-TestMinimumBasicScenario-468943314-project May 26 12:46:14.127771 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: > May 26 12:46:14.127771 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Instance 1a15a237-ed0e-403f-812e-805d26cd19b9 could not be found. May 26 12:46:14.127771 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': '1a15a237-ed0e-403f-812e-805d26cd19b9'} May 26 12:46:14.129532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:46:14.129532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:14.129532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:46:14.129532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:46:14.129532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:46:14.129532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:46:14.129532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:46:14.129532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:46:14.129532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:46:14.129532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:46:14.129532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a15a237-ed0e-403f-812e-805d26cd19b9 could not be found. May 26 12:46:14.129532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:46:14.129532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:46:14.129532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:46:14.129532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:14.129532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:46:14.129532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:46:14.129532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:46:14.129532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:46:14.129532 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:46:14.131140 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:46:14.131140 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:46:14.131140 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:46:14.131140 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:46:14.131140 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:46:14.131140 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:46:14.131140 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:46:14.131140 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a15a237-ed0e-403f-812e-805d26cd19b9 could not be found. May 26 12:46:14.131140 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:46:14.131140 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:46:14.131140 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:46:14.131140 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:14.131140 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:46:14.131140 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:46:14.131140 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:46:14.131140 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:46:14.131140 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a15a237-ed0e-403f-812e-805d26cd19b9 could not be found. May 26 12:46:14.131140 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:46:14.132437 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-71ecbe4a-cf3c-4cdf-aeca-20893b36a2d3 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Returning 404 to user: Instance 1a15a237-ed0e-403f-812e-805d26cd19b9 could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:46:14.132437 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-71ecbe4a-cf3c-4cdf-aeca-20893b36a2d3 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9" status: 404 len: 111 microversion: 2.1 time: 0.041201 May 26 12:46:14.132437 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 616/1240] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:46:14 2022] GET /compute/v2.1/servers/1a15a237-ed0e-403f-812e-805d26cd19b9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:46:14.136530 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-76659830-e24d-4db0-9dd0-98acda21dbb6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] Calling method '.version_select at 0x7fed31d2b5e0>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:14.154801 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-76659830-e24d-4db0-9dd0-98acda21dbb6 tempest-TestMinimumBasicScenario-468943314 tempest-TestMinimumBasicScenario-468943314-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1098404276" status: 202 len: 0 microversion: 2.1 time: 0.022038 May 26 12:46:14.155385 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 625/1241] 10.222.0.39 () {58 vars in 1271 bytes} [Thu May 26 12:46:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1098404276 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:46:14.940454 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-3a53c0fe-b6f4-446a-b60a-6508cd8b80b0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:14.941105 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-3a53c0fe-b6f4-446a-b60a-6508cd8b80b0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:14.947300 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3a53c0fe-b6f4-446a-b60a-6508cd8b80b0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:14.947757 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3a53c0fe-b6f4-446a-b60a-6508cd8b80b0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:14.948523 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3a53c0fe-b6f4-446a-b60a-6508cd8b80b0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:14.948990 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-3a53c0fe-b6f4-446a-b60a-6508cd8b80b0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:15.432394 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-3a53c0fe-b6f4-446a-b60a-6508cd8b80b0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:15.441101 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-3a53c0fe-b6f4-446a-b60a-6508cd8b80b0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 200 len: 1266 microversion: 2.1 time: 0.504931 May 26 12:46:15.441710 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 617/1242] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:46:14 2022] GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 1266 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:16.459506 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-16e14842-dc12-4325-a477-4ff7dd222fb2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:16.460168 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-16e14842-dc12-4325-a477-4ff7dd222fb2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:16.466589 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-16e14842-dc12-4325-a477-4ff7dd222fb2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:16.467037 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-16e14842-dc12-4325-a477-4ff7dd222fb2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:16.467801 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-16e14842-dc12-4325-a477-4ff7dd222fb2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:16.468233 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-16e14842-dc12-4325-a477-4ff7dd222fb2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:16.713087 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-16e14842-dc12-4325-a477-4ff7dd222fb2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:16.725115 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-16e14842-dc12-4325-a477-4ff7dd222fb2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 200 len: 1266 microversion: 2.1 time: 0.269915 May 26 12:46:16.726080 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 626/1243] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:46:16 2022] GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:17.742970 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-bbb28bf0-a5ee-46c5-9809-7ab8f446deb0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:17.743580 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-bbb28bf0-a5ee-46c5-9809-7ab8f446deb0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:17.751083 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bbb28bf0-a5ee-46c5-9809-7ab8f446deb0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:17.751579 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bbb28bf0-a5ee-46c5-9809-7ab8f446deb0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:17.752354 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bbb28bf0-a5ee-46c5-9809-7ab8f446deb0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:17.752826 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-bbb28bf0-a5ee-46c5-9809-7ab8f446deb0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:17.984313 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-bbb28bf0-a5ee-46c5-9809-7ab8f446deb0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:17.992544 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-bbb28bf0-a5ee-46c5-9809-7ab8f446deb0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 200 len: 1266 microversion: 2.1 time: 0.253332 May 26 12:46:17.993328 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 618/1244] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:46:17 2022] GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:19.009268 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-986f0e64-c1e9-47ad-a5e5-f1a25d0172d9 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:19.009867 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-986f0e64-c1e9-47ad-a5e5-f1a25d0172d9 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:19.016982 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-986f0e64-c1e9-47ad-a5e5-f1a25d0172d9 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:19.017431 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-986f0e64-c1e9-47ad-a5e5-f1a25d0172d9 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:19.018318 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-986f0e64-c1e9-47ad-a5e5-f1a25d0172d9 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:19.018756 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-986f0e64-c1e9-47ad-a5e5-f1a25d0172d9 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:19.153404 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-986f0e64-c1e9-47ad-a5e5-f1a25d0172d9 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:19.161712 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-986f0e64-c1e9-47ad-a5e5-f1a25d0172d9 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 200 len: 1266 microversion: 2.1 time: 0.156252 May 26 12:46:19.162271 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 627/1245] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:46:19 2022] GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:20.180276 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-0b2b1797-48f6-45c4-a4cd-f968990c32c9 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:20.181105 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-0b2b1797-48f6-45c4-a4cd-f968990c32c9 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:20.183197 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=2 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:20.184868 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=10 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:20.192344 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0b2b1797-48f6-45c4-a4cd-f968990c32c9 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:20.193035 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0b2b1797-48f6-45c4-a4cd-f968990c32c9 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:20.194046 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0b2b1797-48f6-45c4-a4cd-f968990c32c9 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:20.194716 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0b2b1797-48f6-45c4-a4cd-f968990c32c9 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:20.706627 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-0b2b1797-48f6-45c4-a4cd-f968990c32c9 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:20.714695 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-0b2b1797-48f6-45c4-a4cd-f968990c32c9 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 200 len: 1266 microversion: 2.1 time: 0.539073 May 26 12:46:20.715288 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 619/1246] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:46:20 2022] GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 1266 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:21.739118 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-dd77ae26-9250-4f7a-a1fa-73a6da95d438 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:21.739732 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-dd77ae26-9250-4f7a-a1fa-73a6da95d438 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:21.749129 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-dd77ae26-9250-4f7a-a1fa-73a6da95d438 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:21.749420 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-dd77ae26-9250-4f7a-a1fa-73a6da95d438 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:21.750473 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-dd77ae26-9250-4f7a-a1fa-73a6da95d438 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:21.750917 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-dd77ae26-9250-4f7a-a1fa-73a6da95d438 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:21.972757 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-dd77ae26-9250-4f7a-a1fa-73a6da95d438 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:21.980732 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-dd77ae26-9250-4f7a-a1fa-73a6da95d438 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 200 len: 1266 microversion: 2.1 time: 0.252778 May 26 12:46:21.981426 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 628/1247] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:46:21 2022] GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:23.000246 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-7504069c-5946-45b8-b50c-5f97a6372af9 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:23.000935 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-7504069c-5946-45b8-b50c-5f97a6372af9 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:23.008131 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7504069c-5946-45b8-b50c-5f97a6372af9 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:23.008585 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7504069c-5946-45b8-b50c-5f97a6372af9 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:23.009416 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7504069c-5946-45b8-b50c-5f97a6372af9 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:23.009866 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7504069c-5946-45b8-b50c-5f97a6372af9 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:23.156818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-7504069c-5946-45b8-b50c-5f97a6372af9 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:23.164278 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-7504069c-5946-45b8-b50c-5f97a6372af9 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 200 len: 1266 microversion: 2.1 time: 0.168612 May 26 12:46:23.164918 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 620/1248] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:46:22 2022] GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:46:24.181712 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-cac07aa3-30eb-4699-ab38-301c4484241c tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:24.182317 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-cac07aa3-30eb-4699-ab38-301c4484241c tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:24.189083 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cac07aa3-30eb-4699-ab38-301c4484241c tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:24.189539 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cac07aa3-30eb-4699-ab38-301c4484241c tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:24.190297 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cac07aa3-30eb-4699-ab38-301c4484241c tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:24.190739 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cac07aa3-30eb-4699-ab38-301c4484241c tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:24.327799 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-cac07aa3-30eb-4699-ab38-301c4484241c tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:24.335623 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-cac07aa3-30eb-4699-ab38-301c4484241c tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 200 len: 1266 microversion: 2.1 time: 0.158050 May 26 12:46:24.336186 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 629/1249] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:46:24 2022] GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:25.353034 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-8698d022-d96f-47c9-9bb4-150410a84e48 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:25.353651 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-8698d022-d96f-47c9-9bb4-150410a84e48 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:25.360089 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8698d022-d96f-47c9-9bb4-150410a84e48 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:25.360540 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8698d022-d96f-47c9-9bb4-150410a84e48 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:25.361950 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8698d022-d96f-47c9-9bb4-150410a84e48 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:25.362392 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8698d022-d96f-47c9-9bb4-150410a84e48 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:25.491607 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-8698d022-d96f-47c9-9bb4-150410a84e48 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:25.499313 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-8698d022-d96f-47c9-9bb4-150410a84e48 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 200 len: 1266 microversion: 2.1 time: 0.150203 May 26 12:46:25.499811 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 621/1250] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:46:25 2022] GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:26.517011 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-aa5d02a9-6eee-4d43-b558-de91c477406f tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:26.517620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-aa5d02a9-6eee-4d43-b558-de91c477406f tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:26.524532 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-aa5d02a9-6eee-4d43-b558-de91c477406f tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:26.525015 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-aa5d02a9-6eee-4d43-b558-de91c477406f tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:26.525780 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-aa5d02a9-6eee-4d43-b558-de91c477406f tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:26.526218 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-aa5d02a9-6eee-4d43-b558-de91c477406f tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:26.658083 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-aa5d02a9-6eee-4d43-b558-de91c477406f tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:26.666460 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-aa5d02a9-6eee-4d43-b558-de91c477406f tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 200 len: 1266 microversion: 2.1 time: 0.153360 May 26 12:46:26.666992 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 630/1251] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:46:26 2022] GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:27.090135 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-410f8e8a-2647-4463-af50-7d08032fb036 req-1c9576a0-07cd-4ffc-b01d-1a5cc232f536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a48ffb19-6386-4b90-93f7-16e01c3060da", "name": "network-vif-plugged", "status": "completed", "tag": "adabefab-e666-411d-95db-a8e377570585"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:27.098803 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-410f8e8a-2647-4463-af50-7d08032fb036 req-1c9576a0-07cd-4ffc-b01d-1a5cc232f536 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:27.099255 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-410f8e8a-2647-4463-af50-7d08032fb036 req-1c9576a0-07cd-4ffc-b01d-1a5cc232f536 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:27.110432 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-410f8e8a-2647-4463-af50-7d08032fb036 req-1c9576a0-07cd-4ffc-b01d-1a5cc232f536 service nova] Creating event network-vif-plugged:adabefab-e666-411d-95db-a8e377570585 for instance a48ffb19-6386-4b90-93f7-16e01c3060da on hv-cinder-81514 May 26 12:46:27.115843 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-410f8e8a-2647-4463-af50-7d08032fb036 req-1c9576a0-07cd-4ffc-b01d-1a5cc232f536 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029632 May 26 12:46:27.116487 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 622/1252] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:27.683958 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-9ab092d4-0113-42db-8246-19fcb07b2bbe tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:27.684504 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-9ab092d4-0113-42db-8246-19fcb07b2bbe tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:27.692380 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9ab092d4-0113-42db-8246-19fcb07b2bbe tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:27.692380 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9ab092d4-0113-42db-8246-19fcb07b2bbe tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:27.693032 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9ab092d4-0113-42db-8246-19fcb07b2bbe tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:27.693470 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9ab092d4-0113-42db-8246-19fcb07b2bbe tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:27.827444 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-9ab092d4-0113-42db-8246-19fcb07b2bbe tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:27.835124 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-9ab092d4-0113-42db-8246-19fcb07b2bbe tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 200 len: 1266 microversion: 2.1 time: 0.155127 May 26 12:46:27.835674 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 631/1253] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:46:27 2022] GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:28.852944 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-c6197a4a-61c3-4626-a47b-4553d92e805e tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:28.853708 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-c6197a4a-61c3-4626-a47b-4553d92e805e tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:28.860016 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c6197a4a-61c3-4626-a47b-4553d92e805e tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:28.860475 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c6197a4a-61c3-4626-a47b-4553d92e805e tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:28.861326 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c6197a4a-61c3-4626-a47b-4553d92e805e tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:28.861767 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-c6197a4a-61c3-4626-a47b-4553d92e805e tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:29.004634 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-c6197a4a-61c3-4626-a47b-4553d92e805e tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:29.012199 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-c6197a4a-61c3-4626-a47b-4553d92e805e tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 200 len: 1266 microversion: 2.1 time: 0.164084 May 26 12:46:29.012797 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 623/1254] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:46:28 2022] GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:30.029900 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e65f9654-001b-485d-9a9f-2141b43e0310 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:30.030508 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-e65f9654-001b-485d-9a9f-2141b43e0310 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:30.037185 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e65f9654-001b-485d-9a9f-2141b43e0310 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:30.037633 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e65f9654-001b-485d-9a9f-2141b43e0310 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:30.038384 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e65f9654-001b-485d-9a9f-2141b43e0310 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:30.038819 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e65f9654-001b-485d-9a9f-2141b43e0310 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:30.173274 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-e65f9654-001b-485d-9a9f-2141b43e0310 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:30.183203 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-e65f9654-001b-485d-9a9f-2141b43e0310 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 200 len: 1266 microversion: 2.1 time: 0.157567 May 26 12:46:30.183768 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 632/1255] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:46:30 2022] GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:30.974701 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-734e0164-b7e2-41ba-a287-7ae629c5bd46 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45cd2c84-38de-411a-943f-f9910ea845d1", "device": "/dev/sdb"}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:30.976284 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-734e0164-b7e2-41ba-a287-7ae629c5bd46 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:30.983327 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-734e0164-b7e2-41ba-a287-7ae629c5bd46 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:30.983818 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-734e0164-b7e2-41ba-a287-7ae629c5bd46 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:30.984672 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-734e0164-b7e2-41ba-a287-7ae629c5bd46 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:30.985155 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-734e0164-b7e2-41ba-a287-7ae629c5bd46 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:31.200500 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-0a3d23f3-34de-486c-93eb-0df2d8ed1a58 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:31.201127 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-0a3d23f3-34de-486c-93eb-0df2d8ed1a58 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:31.207656 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0a3d23f3-34de-486c-93eb-0df2d8ed1a58 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:31.208101 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0a3d23f3-34de-486c-93eb-0df2d8ed1a58 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:31.208884 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0a3d23f3-34de-486c-93eb-0df2d8ed1a58 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:31.209318 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0a3d23f3-34de-486c-93eb-0df2d8ed1a58 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:31.352441 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-0a3d23f3-34de-486c-93eb-0df2d8ed1a58 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:31.360128 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-0a3d23f3-34de-486c-93eb-0df2d8ed1a58 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 200 len: 1452 microversion: 2.1 time: 0.163568 May 26 12:46:31.360733 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 633/1256] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:46:31 2022] GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:46:31.377114 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-69671955-659f-4f2d-9a10-0da550394c0a tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:31.377852 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-69671955-659f-4f2d-9a10-0da550394c0a tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:31.385700 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-69671955-659f-4f2d-9a10-0da550394c0a tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:31.386347 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-69671955-659f-4f2d-9a10-0da550394c0a tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:31.387155 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-69671955-659f-4f2d-9a10-0da550394c0a tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:31.387649 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-69671955-659f-4f2d-9a10-0da550394c0a tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:31.454402 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-734e0164-b7e2-41ba-a287-7ae629c5bd46 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "POST /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.483931 May 26 12:46:31.459640 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 624/1257] 10.222.0.39 () {60 vars in 1322 bytes} [Thu May 26 12:46:30 2022] POST /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5/os-volume_attachments => generated 194 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:31.539599 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-69671955-659f-4f2d-9a10-0da550394c0a tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:31.547228 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-69671955-659f-4f2d-9a10-0da550394c0a tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 200 len: 1452 microversion: 2.1 time: 0.174170 May 26 12:46:31.552615 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 634/1258] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:46:31 2022] GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 1452 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:46:34.051561 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-2feaaabf-a8e5-4e4d-9c62-4b77abfda28e req-8ead8b7a-5295-4be5-b502-5297a3255bea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a48ffb19-6386-4b90-93f7-16e01c3060da", "tag": "adabefab-e666-411d-95db-a8e377570585"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:34.060656 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-2feaaabf-a8e5-4e4d-9c62-4b77abfda28e req-8ead8b7a-5295-4be5-b502-5297a3255bea service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:34.061149 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-2feaaabf-a8e5-4e4d-9c62-4b77abfda28e req-8ead8b7a-5295-4be5-b502-5297a3255bea service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:34.072830 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-2feaaabf-a8e5-4e4d-9c62-4b77abfda28e req-8ead8b7a-5295-4be5-b502-5297a3255bea service nova] Creating event network-changed:adabefab-e666-411d-95db-a8e377570585 for instance a48ffb19-6386-4b90-93f7-16e01c3060da on hv-cinder-81514 May 26 12:46:34.078086 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-2feaaabf-a8e5-4e4d-9c62-4b77abfda28e req-8ead8b7a-5295-4be5-b502-5297a3255bea service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030900 May 26 12:46:34.078691 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 625/1259] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:59.265640 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-06998cb3-df71-48e4-a794-8fb253c31047 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:59.266173 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-06998cb3-df71-48e4-a794-8fb253c31047 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:59.268800 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:59.269531 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=77 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:59.275800 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-06998cb3-df71-48e4-a794-8fb253c31047 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:59.276250 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-06998cb3-df71-48e4-a794-8fb253c31047 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:59.277043 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-06998cb3-df71-48e4-a794-8fb253c31047 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:59.277484 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-06998cb3-df71-48e4-a794-8fb253c31047 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:59.359599 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.objects.instance [None req-06998cb3-df71-48e4-a794-8fb253c31047 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lazy-loading 'services' on Instance uuid 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 {{(pid=124134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:46:59.430840 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-06998cb3-df71-48e4-a794-8fb253c31047 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5/os-volume_attachments/45cd2c84-38de-411a-943f-f9910ea845d1" status: 202 len: 0 microversion: 2.1 time: 0.169277 May 26 12:46:59.431416 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 635/1260] 10.222.0.39 () {58 vars in 1415 bytes} [Thu May 26 12:46:59 2022] DELETE /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5/os-volume_attachments/45cd2c84-38de-411a-943f-f9910ea845d1 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:47:00.555107 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=19 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:00.555850 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:00.559784 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-4f9506ac-d32b-4254-9735-49469689ae89 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:00.560354 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-4f9506ac-d32b-4254-9735-49469689ae89 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:00.568693 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4f9506ac-d32b-4254-9735-49469689ae89 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:00.569177 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4f9506ac-d32b-4254-9735-49469689ae89 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:00.569942 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4f9506ac-d32b-4254-9735-49469689ae89 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:00.570374 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4f9506ac-d32b-4254-9735-49469689ae89 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:00.596697 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-4f9506ac-d32b-4254-9735-49469689ae89 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5] Going to try to terminate instance {{(pid=124133) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:47:00.669662 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-4f9506ac-d32b-4254-9735-49469689ae89 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5" status: 204 len: 0 microversion: 2.1 time: 0.115761 May 26 12:47:00.670508 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 626/1261] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:47:00 2022] DELETE /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:47:00.680415 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-429238ed-65d5-4814-887c-d0258ba1bc41 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:00.681149 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-429238ed-65d5-4814-887c-d0258ba1bc41 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:00.687400 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-429238ed-65d5-4814-887c-d0258ba1bc41 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:00.688599 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-429238ed-65d5-4814-887c-d0258ba1bc41 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:00.689659 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-429238ed-65d5-4814-887c-d0258ba1bc41 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:00.690096 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-429238ed-65d5-4814-887c-d0258ba1bc41 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:00.820658 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-429238ed-65d5-4814-887c-d0258ba1bc41 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:00.828188 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-429238ed-65d5-4814-887c-d0258ba1bc41 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5" status: 200 len: 1513 microversion: 2.1 time: 0.152526 May 26 12:47:00.828846 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 636/1262] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:47:00 2022] GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:01.846220 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-fb5368ff-6802-4e7f-8c2d-0e428a08a12f tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:01.846826 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-fb5368ff-6802-4e7f-8c2d-0e428a08a12f tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:01.853235 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fb5368ff-6802-4e7f-8c2d-0e428a08a12f tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:01.853685 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fb5368ff-6802-4e7f-8c2d-0e428a08a12f tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:01.854478 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fb5368ff-6802-4e7f-8c2d-0e428a08a12f tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:01.854911 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-fb5368ff-6802-4e7f-8c2d-0e428a08a12f tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:01.991266 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-fb5368ff-6802-4e7f-8c2d-0e428a08a12f tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:01.998935 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-fb5368ff-6802-4e7f-8c2d-0e428a08a12f tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5" status: 200 len: 1513 microversion: 2.1 time: 0.157187 May 26 12:47:01.999502 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 627/1263] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:47:01 2022] GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:03.017801 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-5b7f701e-ef46-44c3-8e5a-bb6c0726ced9 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:03.018445 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-5b7f701e-ef46-44c3-8e5a-bb6c0726ced9 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:03.025570 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5b7f701e-ef46-44c3-8e5a-bb6c0726ced9 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:03.026065 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5b7f701e-ef46-44c3-8e5a-bb6c0726ced9 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:03.026822 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5b7f701e-ef46-44c3-8e5a-bb6c0726ced9 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:03.027257 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-5b7f701e-ef46-44c3-8e5a-bb6c0726ced9 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:03.171426 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-5b7f701e-ef46-44c3-8e5a-bb6c0726ced9 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:03.179027 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-5b7f701e-ef46-44c3-8e5a-bb6c0726ced9 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5" status: 200 len: 1513 microversion: 2.1 time: 0.165735 May 26 12:47:03.179527 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 637/1264] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:47:03 2022] GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:03.518626 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-6e15d1ae-620d-4eb8-b61b-74c7db48a0bb req-167d0d2a-fd6e-43ff-a768-f411885a5e9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8188d09d-ca9c-40a9-b5ed-31c897e6b5f5", "name": "network-vif-deleted", "tag": "fcda70e8-4784-4b67-a44b-4bbb714c2143"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:03.527908 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-6e15d1ae-620d-4eb8-b61b-74c7db48a0bb req-167d0d2a-fd6e-43ff-a768-f411885a5e9a service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:03.528357 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-6e15d1ae-620d-4eb8-b61b-74c7db48a0bb req-167d0d2a-fd6e-43ff-a768-f411885a5e9a service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:03.540310 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-6e15d1ae-620d-4eb8-b61b-74c7db48a0bb req-167d0d2a-fd6e-43ff-a768-f411885a5e9a service nova] Creating event network-vif-deleted:fcda70e8-4784-4b67-a44b-4bbb714c2143 for instance 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 on hv-cinder-81514 May 26 12:47:03.545075 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-6e15d1ae-620d-4eb8-b61b-74c7db48a0bb req-167d0d2a-fd6e-43ff-a768-f411885a5e9a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031474 May 26 12:47:03.546057 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 628/1265] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:04.196955 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-2ecdef49-e65c-4b3a-9124-ddfbc4e405bc tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:04.197516 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-2ecdef49-e65c-4b3a-9124-ddfbc4e405bc tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:04.204670 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2ecdef49-e65c-4b3a-9124-ddfbc4e405bc tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:04.205588 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2ecdef49-e65c-4b3a-9124-ddfbc4e405bc tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:04.206758 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2ecdef49-e65c-4b3a-9124-ddfbc4e405bc tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:04.207582 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-2ecdef49-e65c-4b3a-9124-ddfbc4e405bc tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:04.221635 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.wsgi [None req-2ecdef49-e65c-4b3a-9124-ddfbc4e405bc tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] HTTP exception thrown: Instance 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 could not be found. May 26 12:47:04.223281 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-2ecdef49-e65c-4b3a-9124-ddfbc4e405bc tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Request method failure captured: May 26 12:47:04.223281 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: request: GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 HTTP/1.1 May 26 12:47:04.223281 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept: application/json May 26 12:47:04.223281 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept-Encoding: identity May 26 12:47:04.223281 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Connection: close May 26 12:47:04.223281 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Length: 0 May 26 12:47:04.223281 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Type: application/json May 26 12:47:04.223281 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Host: 10.222.0.39 May 26 12:47:04.223281 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Openstack-System-Scope: None May 26 12:47:04.223281 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: User-Agent: python-urllib3/1.26.9 May 26 12:47:04.223281 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Auth-Token: gAAAAABij3Z2KcL54dAK5wkDwdQHFJCyQUxcsNHVUkQUeJJolZeXcAcaUNFnur5Vj2EP6iKYZbYa7z4WifqYBbrZ6AeqpEoT_VvHLv0Av_8fKwk79wIto8G9oqqHviYYy6u6WmaINWWsD879VrJmSZdyj0OEcnP3hWd7MygOPU-A-Njo_htZsjU May 26 12:47:04.223281 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Id: None May 26 12:47:04.223281 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Name: None May 26 12:47:04.223281 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Identity-Status: Confirmed May 26 12:47:04.223281 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Is-Admin-Project: True May 26 12:47:04.223281 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Id: default May 26 12:47:04.223281 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Name: Default May 26 12:47:04.223281 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Id: 967941c42e3046b4b5e929dbc446d2f3 May 26 12:47:04.223281 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Name: tempest-VolumesSnapshotTestJSON-462438896 May 26 12:47:04.223281 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Role: member,reader May 26 12:47:04.223281 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Roles: member,reader May 26 12:47:04.225083 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/967941c42e3046b4b5e929dbc446d2f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_967941c42e3046b4b5e929dbc446d2f3", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/967941c42e3046b4b5e929dbc446d2f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/967941c42e3046b4b5e929dbc446d2f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:47:04.225083 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant: tempest-VolumesSnapshotTestJSON-462438896 May 26 12:47:04.225083 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Id: 967941c42e3046b4b5e929dbc446d2f3 May 26 12:47:04.225083 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-462438896 May 26 12:47:04.225083 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User: tempest-VolumesSnapshotTestJSON-462438896-project May 26 12:47:04.225083 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Id: default May 26 12:47:04.225083 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Name: Default May 26 12:47:04.225083 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Id: 7ef548f433e444a2892e772165ce1e11 May 26 12:47:04.225083 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Name: tempest-VolumesSnapshotTestJSON-462438896-project May 26 12:47:04.225083 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: method: > May 26 12:47:04.225083 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: exception: Instance 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 could not be found. May 26 12:47:04.225083 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: action_args: {'id': '8188d09d-ca9c-40a9-b5ed-31c897e6b5f5'} May 26 12:47:04.226067 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:47:04.226067 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:04.226067 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:47:04.226067 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:47:04.226067 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:47:04.226067 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:47:04.226067 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:47:04.226067 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:47:04.226067 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:47:04.226067 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:47:04.226067 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 could not be found. May 26 12:47:04.226067 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:47:04.226067 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:04.226067 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:47:04.226067 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:04.226067 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:04.226067 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:04.226067 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:47:04.226067 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:47:04.226067 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:47:04.227482 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:47:04.227482 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:47:04.227482 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:47:04.227482 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:47:04.227482 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:47:04.227482 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:47:04.227482 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:47:04.227482 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 could not be found. May 26 12:47:04.227482 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:47:04.227482 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:04.227482 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:47:04.227482 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:04.227482 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:04.227482 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:04.227482 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:47:04.227482 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:47:04.227482 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 could not be found. May 26 12:47:04.227482 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:47:04.228819 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-2ecdef49-e65c-4b3a-9124-ddfbc4e405bc tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Returning 404 to user: Instance 8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 could not be found. {{(pid=124134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:47:04.228819 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-2ecdef49-e65c-4b3a-9124-ddfbc4e405bc tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5" status: 404 len: 111 microversion: 2.1 time: 0.031759 May 26 12:47:04.228819 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 638/1266] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:47:04 2022] GET /compute/v2.1/servers/8188d09d-ca9c-40a9-b5ed-31c897e6b5f5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:47:15.168254 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:15.169136 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:15.174351 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ba7927c6-ae9c-4b45-918f-9234afbeac41 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1285035657", "imageRef": "7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4", "flavorRef": "452", "networks": [{"uuid": "bd3edabd-1e0f-4834-83d9-7eea55ba3e26"}]}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:15.229145 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.network.neutron [None req-ba7927c6-ae9c-4b45-918f-9234afbeac41 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] validate_networks() for [('bd3edabd-1e0f-4834-83d9-7eea55ba3e26', None, None, None, None, None)] {{(pid=124133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:47:15.583065 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-ba7927c6-ae9c-4b45-918f-9234afbeac41 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Flavor limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:47:15.583495 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-ba7927c6-ae9c-4b45-918f-9234afbeac41 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Image limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:47:15.583972 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-ba7927c6-ae9c-4b45-918f-9234afbeac41 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Flavor pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:47:15.584413 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-ba7927c6-ae9c-4b45-918f-9234afbeac41 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Image pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:47:15.584853 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-ba7927c6-ae9c-4b45-918f-9234afbeac41 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:47:15.593716 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ba7927c6-ae9c-4b45-918f-9234afbeac41 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:15.594893 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ba7927c6-ae9c-4b45-918f-9234afbeac41 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:15.595690 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ba7927c6-ae9c-4b45-918f-9234afbeac41 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:15.596133 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ba7927c6-ae9c-4b45-918f-9234afbeac41 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:15.612903 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-ba7927c6-ae9c-4b45-918f-9234afbeac41 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Getting quotas for project 967941c42e3046b4b5e929dbc446d2f3. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:47:15.616863 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-ba7927c6-ae9c-4b45-918f-9234afbeac41 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Getting quotas for user 7ef548f433e444a2892e772165ce1e11 and project 967941c42e3046b4b5e929dbc446d2f3. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:47:15.627657 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ba7927c6-ae9c-4b45-918f-9234afbeac41 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Going to run 1 instances... {{(pid=124133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:47:15.630045 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ba7927c6-ae9c-4b45-918f-9234afbeac41 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 38060ac5-fd27-41ae-92d3-18723035ee74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c2ca415-f4e6-4558-b5d5-ee7b02f56bb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:47:15.676010 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ba7927c6-ae9c-4b45-918f-9234afbeac41 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.508922 May 26 12:47:15.677155 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 629/1267] 10.222.0.39 () {60 vars in 1146 bytes} [Thu May 26 12:47:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:47:15.687247 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-ed9b6f4a-d49c-4c22-9168-608f87e21888 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:15.688417 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-ed9b6f4a-d49c-4c22-9168-608f87e21888 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 38060ac5-fd27-41ae-92d3-18723035ee74] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:15.690453 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=8 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:15.691244 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:15.749148 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-ed9b6f4a-d49c-4c22-9168-608f87e21888 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:15.757358 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-ed9b6f4a-d49c-4c22-9168-608f87e21888 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74" status: 200 len: 1219 microversion: 2.1 time: 0.073978 May 26 12:47:15.758053 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 639/1268] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:47:15 2022] GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74 => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:16.777240 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-550b9e7e-eb59-47fd-b1d8-3b81fb3e8408 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:16.779053 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-550b9e7e-eb59-47fd-b1d8-3b81fb3e8408 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 38060ac5-fd27-41ae-92d3-18723035ee74] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:16.789282 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-550b9e7e-eb59-47fd-b1d8-3b81fb3e8408 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:16.790109 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-550b9e7e-eb59-47fd-b1d8-3b81fb3e8408 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:16.791314 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-550b9e7e-eb59-47fd-b1d8-3b81fb3e8408 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:16.791891 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-550b9e7e-eb59-47fd-b1d8-3b81fb3e8408 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:16.874017 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-550b9e7e-eb59-47fd-b1d8-3b81fb3e8408 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:16.881789 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-550b9e7e-eb59-47fd-b1d8-3b81fb3e8408 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74" status: 200 len: 1289 microversion: 2.1 time: 0.110268 May 26 12:47:16.882358 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 630/1269] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:47:16 2022] GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74 => generated 1289 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:47:17.899791 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-cf9da1db-af13-47e1-ae27-f085125739d2 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:17.900505 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-cf9da1db-af13-47e1-ae27-f085125739d2 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 38060ac5-fd27-41ae-92d3-18723035ee74] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:17.907825 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cf9da1db-af13-47e1-ae27-f085125739d2 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:17.908370 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cf9da1db-af13-47e1-ae27-f085125739d2 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:17.909172 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cf9da1db-af13-47e1-ae27-f085125739d2 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:17.909614 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cf9da1db-af13-47e1-ae27-f085125739d2 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:18.067719 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-cf9da1db-af13-47e1-ae27-f085125739d2 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:18.078194 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-cf9da1db-af13-47e1-ae27-f085125739d2 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74" status: 200 len: 1319 microversion: 2.1 time: 0.182834 May 26 12:47:18.078945 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 640/1270] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:47:17 2022] GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:47:18.103702 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-86964ca4-0cea-4bc4-b1f1-cbea9febf4ac req-3fb19553-c6fa-495e-9e60-609426f1a8a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38060ac5-fd27-41ae-92d3-18723035ee74", "tag": "bcd10355-5981-4e49-9c1b-f1472794da73"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:18.113544 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-86964ca4-0cea-4bc4-b1f1-cbea9febf4ac req-3fb19553-c6fa-495e-9e60-609426f1a8a1 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:18.114085 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-86964ca4-0cea-4bc4-b1f1-cbea9febf4ac req-3fb19553-c6fa-495e-9e60-609426f1a8a1 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:18.128830 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-86964ca4-0cea-4bc4-b1f1-cbea9febf4ac req-3fb19553-c6fa-495e-9e60-609426f1a8a1 service nova] Creating event network-changed:bcd10355-5981-4e49-9c1b-f1472794da73 for instance 38060ac5-fd27-41ae-92d3-18723035ee74 on hv-cinder-81514 May 26 12:47:18.133848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-86964ca4-0cea-4bc4-b1f1-cbea9febf4ac req-3fb19553-c6fa-495e-9e60-609426f1a8a1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033742 May 26 12:47:18.134588 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 631/1271] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:19.096216 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-a283ec08-3f94-425a-ba93-6194f04a4569 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:19.096845 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-a283ec08-3f94-425a-ba93-6194f04a4569 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 38060ac5-fd27-41ae-92d3-18723035ee74] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:19.103281 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a283ec08-3f94-425a-ba93-6194f04a4569 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:19.103724 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a283ec08-3f94-425a-ba93-6194f04a4569 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:19.104480 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a283ec08-3f94-425a-ba93-6194f04a4569 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:19.104944 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a283ec08-3f94-425a-ba93-6194f04a4569 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:19.235083 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a283ec08-3f94-425a-ba93-6194f04a4569 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:19.242798 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-a283ec08-3f94-425a-ba93-6194f04a4569 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74" status: 200 len: 1319 microversion: 2.1 time: 0.151068 May 26 12:47:19.243359 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 641/1272] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:47:19 2022] GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:20.260312 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-4afc00e7-0934-4e9c-acb6-0815079df34a tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:20.261053 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-4afc00e7-0934-4e9c-acb6-0815079df34a tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 38060ac5-fd27-41ae-92d3-18723035ee74] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:20.267939 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4afc00e7-0934-4e9c-acb6-0815079df34a tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:20.268381 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4afc00e7-0934-4e9c-acb6-0815079df34a tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:20.269161 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4afc00e7-0934-4e9c-acb6-0815079df34a tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:20.269599 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-4afc00e7-0934-4e9c-acb6-0815079df34a tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:20.401517 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-4afc00e7-0934-4e9c-acb6-0815079df34a tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:20.409304 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-4afc00e7-0934-4e9c-acb6-0815079df34a tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74" status: 200 len: 1319 microversion: 2.1 time: 0.153618 May 26 12:47:20.409864 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 632/1273] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:47:20 2022] GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:21.426897 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-3180596a-04be-44fa-b398-f4a1c4901740 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:21.427623 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-3180596a-04be-44fa-b398-f4a1c4901740 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 38060ac5-fd27-41ae-92d3-18723035ee74] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:21.435627 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3180596a-04be-44fa-b398-f4a1c4901740 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:21.436351 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3180596a-04be-44fa-b398-f4a1c4901740 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:21.437750 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3180596a-04be-44fa-b398-f4a1c4901740 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:21.438524 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-3180596a-04be-44fa-b398-f4a1c4901740 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:21.584085 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-3180596a-04be-44fa-b398-f4a1c4901740 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:21.595575 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-3180596a-04be-44fa-b398-f4a1c4901740 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74" status: 200 len: 1319 microversion: 2.1 time: 0.170895 May 26 12:47:21.596237 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 642/1274] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:47:21 2022] GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:22.617628 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-71d22b08-3a63-4be3-b8c7-ac4a5a62eaad tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:22.618206 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-71d22b08-3a63-4be3-b8c7-ac4a5a62eaad tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 38060ac5-fd27-41ae-92d3-18723035ee74] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:22.627130 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-71d22b08-3a63-4be3-b8c7-ac4a5a62eaad tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:22.627710 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-71d22b08-3a63-4be3-b8c7-ac4a5a62eaad tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:22.628519 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-71d22b08-3a63-4be3-b8c7-ac4a5a62eaad tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:22.629023 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-71d22b08-3a63-4be3-b8c7-ac4a5a62eaad tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:22.761302 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-71d22b08-3a63-4be3-b8c7-ac4a5a62eaad tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:22.770198 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-71d22b08-3a63-4be3-b8c7-ac4a5a62eaad tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74" status: 200 len: 1319 microversion: 2.1 time: 0.156547 May 26 12:47:22.770804 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 633/1275] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:47:22 2022] GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:47:23.788160 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f8c75fa4-3f64-4ef2-893c-18c32c187f39 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:23.788779 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-f8c75fa4-3f64-4ef2-893c-18c32c187f39 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 38060ac5-fd27-41ae-92d3-18723035ee74] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:23.795255 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f8c75fa4-3f64-4ef2-893c-18c32c187f39 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:23.795704 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f8c75fa4-3f64-4ef2-893c-18c32c187f39 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:23.796453 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f8c75fa4-3f64-4ef2-893c-18c32c187f39 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:23.796992 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f8c75fa4-3f64-4ef2-893c-18c32c187f39 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:23.931638 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-f8c75fa4-3f64-4ef2-893c-18c32c187f39 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:23.939558 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-f8c75fa4-3f64-4ef2-893c-18c32c187f39 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74" status: 200 len: 1319 microversion: 2.1 time: 0.155239 May 26 12:47:23.940118 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 643/1276] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:47:23 2022] GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:24.351049 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-9e277811-e15d-4ddd-a930-a88a20a39b58 req-9d7a98c0-9ca1-4af4-9d87-65889481c3eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38060ac5-fd27-41ae-92d3-18723035ee74", "name": "network-vif-plugged", "status": "completed", "tag": "bcd10355-5981-4e49-9c1b-f1472794da73"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:24.361230 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-9e277811-e15d-4ddd-a930-a88a20a39b58 req-9d7a98c0-9ca1-4af4-9d87-65889481c3eb service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:24.361670 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-9e277811-e15d-4ddd-a930-a88a20a39b58 req-9d7a98c0-9ca1-4af4-9d87-65889481c3eb service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:24.373292 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-9e277811-e15d-4ddd-a930-a88a20a39b58 req-9d7a98c0-9ca1-4af4-9d87-65889481c3eb service nova] Creating event network-vif-plugged:bcd10355-5981-4e49-9c1b-f1472794da73 for instance 38060ac5-fd27-41ae-92d3-18723035ee74 on hv-cinder-81514 May 26 12:47:24.378954 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-9e277811-e15d-4ddd-a930-a88a20a39b58 req-9d7a98c0-9ca1-4af4-9d87-65889481c3eb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032120 May 26 12:47:24.379641 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 634/1277] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:24.959519 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f15b6106-e280-4b79-b745-f192fb610bff tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:24.960339 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-f15b6106-e280-4b79-b745-f192fb610bff tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 38060ac5-fd27-41ae-92d3-18723035ee74] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:24.966790 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f15b6106-e280-4b79-b745-f192fb610bff tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:24.967252 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f15b6106-e280-4b79-b745-f192fb610bff tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:24.968014 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f15b6106-e280-4b79-b745-f192fb610bff tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:24.968541 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f15b6106-e280-4b79-b745-f192fb610bff tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:25.101497 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-f15b6106-e280-4b79-b745-f192fb610bff tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:25.109159 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-f15b6106-e280-4b79-b745-f192fb610bff tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74" status: 200 len: 1319 microversion: 2.1 time: 0.153454 May 26 12:47:25.109728 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 644/1278] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:47:24 2022] GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:26.124701 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=2 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:26.126222 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=6 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:26.131076 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e757ee99-063a-4709-94e7-b4ec22b12fde tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:26.131834 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e757ee99-063a-4709-94e7-b4ec22b12fde tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 38060ac5-fd27-41ae-92d3-18723035ee74] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:26.139205 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e757ee99-063a-4709-94e7-b4ec22b12fde tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:26.139650 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e757ee99-063a-4709-94e7-b4ec22b12fde tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:26.140933 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e757ee99-063a-4709-94e7-b4ec22b12fde tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:26.141371 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e757ee99-063a-4709-94e7-b4ec22b12fde tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:26.399172 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e757ee99-063a-4709-94e7-b4ec22b12fde tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:26.407234 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e757ee99-063a-4709-94e7-b4ec22b12fde tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74" status: 200 len: 1319 microversion: 2.1 time: 0.283593 May 26 12:47:26.407822 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 635/1279] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:47:26 2022] GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74 => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:27.424858 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-c68a7b4d-e71c-48aa-8096-01b24d025b27 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:27.425729 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-c68a7b4d-e71c-48aa-8096-01b24d025b27 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 38060ac5-fd27-41ae-92d3-18723035ee74] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:27.427775 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell0:SELECT=2 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:27.433520 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c68a7b4d-e71c-48aa-8096-01b24d025b27 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:27.433963 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c68a7b4d-e71c-48aa-8096-01b24d025b27 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:27.434723 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c68a7b4d-e71c-48aa-8096-01b24d025b27 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:27.435159 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-c68a7b4d-e71c-48aa-8096-01b24d025b27 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:27.624474 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-c68a7b4d-e71c-48aa-8096-01b24d025b27 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:27.632052 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-c68a7b4d-e71c-48aa-8096-01b24d025b27 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74" status: 200 len: 1507 microversion: 2.1 time: 0.211981 May 26 12:47:27.632614 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 645/1280] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:47:27 2022] GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74 => generated 1507 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:47:27.649240 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-13f66eb9-954e-408c-8387-6a40d7e4833b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8827cbc0-d2d4-42a5-91c8-3bab4e749d4f", "device": "/dev/sdb"}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:27.650324 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-13f66eb9-954e-408c-8387-6a40d7e4833b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 38060ac5-fd27-41ae-92d3-18723035ee74] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:27.657837 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-13f66eb9-954e-408c-8387-6a40d7e4833b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:27.658284 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-13f66eb9-954e-408c-8387-6a40d7e4833b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:27.659045 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-13f66eb9-954e-408c-8387-6a40d7e4833b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:27.659478 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-13f66eb9-954e-408c-8387-6a40d7e4833b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:27.928887 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-13f66eb9-954e-408c-8387-6a40d7e4833b tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "POST /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283787 May 26 12:47:27.929543 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 636/1281] 10.222.0.39 () {60 vars in 1322 bytes} [Thu May 26 12:47:27 2022] POST /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:28.726269 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:47:28.726830 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Thu May 26 12:47:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 12:47:38.154425 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:47:38.154975 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Thu May 26 12:47:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 12:47:50.353938 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b3cec2a5-2e38-49a7-bf48-bafb97b73bcc tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:50.354465 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b3cec2a5-2e38-49a7-bf48-bafb97b73bcc tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 38060ac5-fd27-41ae-92d3-18723035ee74] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:50.356570 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=16 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:50.357280 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=36 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:50.364307 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b3cec2a5-2e38-49a7-bf48-bafb97b73bcc tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:50.364775 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b3cec2a5-2e38-49a7-bf48-bafb97b73bcc tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:50.365531 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b3cec2a5-2e38-49a7-bf48-bafb97b73bcc tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:50.365960 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b3cec2a5-2e38-49a7-bf48-bafb97b73bcc tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:50.452114 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.objects.instance [None req-b3cec2a5-2e38-49a7-bf48-bafb97b73bcc tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lazy-loading 'services' on Instance uuid 38060ac5-fd27-41ae-92d3-18723035ee74 {{(pid=124134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:47:50.524430 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b3cec2a5-2e38-49a7-bf48-bafb97b73bcc tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "DELETE /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74/os-volume_attachments/8827cbc0-d2d4-42a5-91c8-3bab4e749d4f" status: 202 len: 0 microversion: 2.1 time: 0.174070 May 26 12:47:50.525106 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 646/1282] 10.222.0.39 () {58 vars in 1415 bytes} [Thu May 26 12:47:50 2022] DELETE /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74/os-volume_attachments/8827cbc0-d2d4-42a5-91c8-3bab4e749d4f => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:47:51.636490 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:51.637277 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:51.641622 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-d950f4a3-ccc4-4ba6-804b-0a99ed083bdd tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:51.642204 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d950f4a3-ccc4-4ba6-804b-0a99ed083bdd tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 38060ac5-fd27-41ae-92d3-18723035ee74] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:51.651273 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d950f4a3-ccc4-4ba6-804b-0a99ed083bdd tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:51.651723 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d950f4a3-ccc4-4ba6-804b-0a99ed083bdd tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:51.652493 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d950f4a3-ccc4-4ba6-804b-0a99ed083bdd tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:51.652962 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-d950f4a3-ccc4-4ba6-804b-0a99ed083bdd tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:51.678071 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-d950f4a3-ccc4-4ba6-804b-0a99ed083bdd tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 38060ac5-fd27-41ae-92d3-18723035ee74] Going to try to terminate instance {{(pid=124133) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:47:51.754699 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-d950f4a3-ccc4-4ba6-804b-0a99ed083bdd tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "DELETE /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74" status: 204 len: 0 microversion: 2.1 time: 0.119421 May 26 12:47:51.755449 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 637/1283] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:47:51 2022] DELETE /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:47:51.764749 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-283a4e68-3012-4c04-9b7c-46e642dffe63 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:51.765437 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-283a4e68-3012-4c04-9b7c-46e642dffe63 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 38060ac5-fd27-41ae-92d3-18723035ee74] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:51.771612 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-283a4e68-3012-4c04-9b7c-46e642dffe63 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:51.772055 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-283a4e68-3012-4c04-9b7c-46e642dffe63 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:51.773090 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-283a4e68-3012-4c04-9b7c-46e642dffe63 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:51.773520 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-283a4e68-3012-4c04-9b7c-46e642dffe63 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:51.905449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-283a4e68-3012-4c04-9b7c-46e642dffe63 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:51.913475 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-283a4e68-3012-4c04-9b7c-46e642dffe63 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74" status: 200 len: 1513 microversion: 2.1 time: 0.153387 May 26 12:47:51.914028 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 647/1284] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:47:51 2022] GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:52.932097 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-2788fbd9-2e10-40a1-b9a5-f6499703ffcc tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:52.932819 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-2788fbd9-2e10-40a1-b9a5-f6499703ffcc tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 38060ac5-fd27-41ae-92d3-18723035ee74] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:52.939332 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2788fbd9-2e10-40a1-b9a5-f6499703ffcc tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:52.940476 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2788fbd9-2e10-40a1-b9a5-f6499703ffcc tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:52.941291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2788fbd9-2e10-40a1-b9a5-f6499703ffcc tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:52.941753 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2788fbd9-2e10-40a1-b9a5-f6499703ffcc tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:53.068569 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-2788fbd9-2e10-40a1-b9a5-f6499703ffcc tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:53.076011 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-2788fbd9-2e10-40a1-b9a5-f6499703ffcc tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74" status: 200 len: 1513 microversion: 2.1 time: 0.148266 May 26 12:47:53.076564 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 638/1285] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:47:52 2022] GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:54.093372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-39bf7ed9-47ea-4a02-bdf0-3b14986047ee tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:54.093973 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-39bf7ed9-47ea-4a02-bdf0-3b14986047ee tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 38060ac5-fd27-41ae-92d3-18723035ee74] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:54.100624 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-39bf7ed9-47ea-4a02-bdf0-3b14986047ee tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:54.101168 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-39bf7ed9-47ea-4a02-bdf0-3b14986047ee tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:54.101924 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-39bf7ed9-47ea-4a02-bdf0-3b14986047ee tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:54.102417 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-39bf7ed9-47ea-4a02-bdf0-3b14986047ee tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:54.231084 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-39bf7ed9-47ea-4a02-bdf0-3b14986047ee tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef548f433e444a2892e772165ce1e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967941c42e3046b4b5e929dbc446d2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:54.239637 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-39bf7ed9-47ea-4a02-bdf0-3b14986047ee tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74" status: 200 len: 1513 microversion: 2.1 time: 0.150023 May 26 12:47:54.240216 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 648/1286] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:47:54 2022] GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:54.573654 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-d3ba3938-c2ad-405c-82f9-45c28a401971 req-cfa143b6-f5fa-4873-b32b-3dad864821c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38060ac5-fd27-41ae-92d3-18723035ee74", "name": "network-vif-deleted", "tag": "bcd10355-5981-4e49-9c1b-f1472794da73"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:54.584230 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-d3ba3938-c2ad-405c-82f9-45c28a401971 req-cfa143b6-f5fa-4873-b32b-3dad864821c5 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:54.584675 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-d3ba3938-c2ad-405c-82f9-45c28a401971 req-cfa143b6-f5fa-4873-b32b-3dad864821c5 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:54.597190 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-d3ba3938-c2ad-405c-82f9-45c28a401971 req-cfa143b6-f5fa-4873-b32b-3dad864821c5 service nova] Creating event network-vif-deleted:bcd10355-5981-4e49-9c1b-f1472794da73 for instance 38060ac5-fd27-41ae-92d3-18723035ee74 on hv-cinder-81514 May 26 12:47:54.602212 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-d3ba3938-c2ad-405c-82f9-45c28a401971 req-cfa143b6-f5fa-4873-b32b-3dad864821c5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032416 May 26 12:47:54.602843 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 639/1287] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:55.257101 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-135be96b-0b0a-472f-9de2-9d8eecef4362 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:55.257712 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-135be96b-0b0a-472f-9de2-9d8eecef4362 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] [instance: 38060ac5-fd27-41ae-92d3-18723035ee74] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:55.264922 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-135be96b-0b0a-472f-9de2-9d8eecef4362 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:55.265372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-135be96b-0b0a-472f-9de2-9d8eecef4362 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:55.266131 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-135be96b-0b0a-472f-9de2-9d8eecef4362 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:55.266570 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-135be96b-0b0a-472f-9de2-9d8eecef4362 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:55.280333 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.wsgi [None req-135be96b-0b0a-472f-9de2-9d8eecef4362 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] HTTP exception thrown: Instance 38060ac5-fd27-41ae-92d3-18723035ee74 could not be found. May 26 12:47:55.282003 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-135be96b-0b0a-472f-9de2-9d8eecef4362 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Request method failure captured: May 26 12:47:55.282003 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: request: GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74 HTTP/1.1 May 26 12:47:55.282003 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept: application/json May 26 12:47:55.282003 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept-Encoding: identity May 26 12:47:55.282003 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Connection: close May 26 12:47:55.282003 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Length: 0 May 26 12:47:55.282003 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Type: application/json May 26 12:47:55.282003 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Host: 10.222.0.39 May 26 12:47:55.282003 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Openstack-System-Scope: None May 26 12:47:55.282003 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: User-Agent: python-urllib3/1.26.9 May 26 12:47:55.282003 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Auth-Token: gAAAAABij3Z2KcL54dAK5wkDwdQHFJCyQUxcsNHVUkQUeJJolZeXcAcaUNFnur5Vj2EP6iKYZbYa7z4WifqYBbrZ6AeqpEoT_VvHLv0Av_8fKwk79wIto8G9oqqHviYYy6u6WmaINWWsD879VrJmSZdyj0OEcnP3hWd7MygOPU-A-Njo_htZsjU May 26 12:47:55.282003 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Id: None May 26 12:47:55.282003 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Name: None May 26 12:47:55.282003 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Identity-Status: Confirmed May 26 12:47:55.282003 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Is-Admin-Project: True May 26 12:47:55.282003 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Id: default May 26 12:47:55.282003 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Name: Default May 26 12:47:55.282003 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Id: 967941c42e3046b4b5e929dbc446d2f3 May 26 12:47:55.282003 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Name: tempest-VolumesSnapshotTestJSON-462438896 May 26 12:47:55.282003 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Role: member,reader May 26 12:47:55.282003 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Roles: member,reader May 26 12:47:55.284609 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/967941c42e3046b4b5e929dbc446d2f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_967941c42e3046b4b5e929dbc446d2f3", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/967941c42e3046b4b5e929dbc446d2f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/967941c42e3046b4b5e929dbc446d2f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:47:55.284609 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant: tempest-VolumesSnapshotTestJSON-462438896 May 26 12:47:55.284609 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Id: 967941c42e3046b4b5e929dbc446d2f3 May 26 12:47:55.284609 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-462438896 May 26 12:47:55.284609 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User: tempest-VolumesSnapshotTestJSON-462438896-project May 26 12:47:55.284609 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Id: default May 26 12:47:55.284609 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Name: Default May 26 12:47:55.284609 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Id: 7ef548f433e444a2892e772165ce1e11 May 26 12:47:55.284609 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Name: tempest-VolumesSnapshotTestJSON-462438896-project May 26 12:47:55.284609 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: method: > May 26 12:47:55.284609 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: exception: Instance 38060ac5-fd27-41ae-92d3-18723035ee74 could not be found. May 26 12:47:55.284609 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: action_args: {'id': '38060ac5-fd27-41ae-92d3-18723035ee74'} May 26 12:47:55.285629 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:47:55.285629 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:55.285629 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:47:55.285629 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:47:55.285629 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:47:55.285629 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:47:55.285629 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:47:55.285629 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:47:55.285629 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:47:55.285629 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:47:55.285629 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38060ac5-fd27-41ae-92d3-18723035ee74 could not be found. May 26 12:47:55.285629 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:47:55.285629 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:55.285629 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:47:55.285629 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:55.285629 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:55.285629 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:55.285629 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:47:55.285629 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:47:55.285629 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:47:55.287314 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:47:55.287314 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:47:55.287314 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:47:55.287314 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:47:55.287314 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:47:55.287314 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:47:55.287314 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:47:55.287314 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38060ac5-fd27-41ae-92d3-18723035ee74 could not be found. May 26 12:47:55.287314 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:47:55.287314 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:55.287314 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:47:55.287314 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:55.287314 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:55.287314 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:55.287314 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:47:55.287314 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:47:55.287314 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38060ac5-fd27-41ae-92d3-18723035ee74 could not be found. May 26 12:47:55.287314 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:47:55.288852 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-135be96b-0b0a-472f-9de2-9d8eecef4362 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] Returning 404 to user: Instance 38060ac5-fd27-41ae-92d3-18723035ee74 could not be found. {{(pid=124134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:47:55.288852 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-135be96b-0b0a-472f-9de2-9d8eecef4362 tempest-VolumesSnapshotTestJSON-462438896 tempest-VolumesSnapshotTestJSON-462438896-project] 10.222.0.39 "GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74" status: 404 len: 111 microversion: 2.1 time: 0.030480 May 26 12:47:55.288852 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 649/1288] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:47:55 2022] GET /compute/v2.1/servers/38060ac5-fd27-41ae-92d3-18723035ee74 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:49:26.529173 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:26.529913 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:26.535020 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-b2fbfb5b-0c89-414d-9966-41d84fe1a1ab tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:26.535609 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-b2fbfb5b-0c89-414d-9966-41d84fe1a1ab tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:26.555387 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b2fbfb5b-0c89-414d-9966-41d84fe1a1ab tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:26.555848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b2fbfb5b-0c89-414d-9966-41d84fe1a1ab tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:26.556647 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b2fbfb5b-0c89-414d-9966-41d84fe1a1ab tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:26.557120 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b2fbfb5b-0c89-414d-9966-41d84fe1a1ab tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:26.586320 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-b2fbfb5b-0c89-414d-9966-41d84fe1a1ab tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Going to try to terminate instance {{(pid=124133) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:49:26.663420 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-b2fbfb5b-0c89-414d-9966-41d84fe1a1ab tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 204 len: 0 microversion: 2.1 time: 0.136535 May 26 12:49:26.664112 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 640/1289] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:49:26 2022] DELETE /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:49:26.670759 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=8 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:26.671491 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:26.675928 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-8eb73e84-8ed1-4d8f-9ad0-9960cbab9993 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:26.676529 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-8eb73e84-8ed1-4d8f-9ad0-9960cbab9993 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:26.684594 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8eb73e84-8ed1-4d8f-9ad0-9960cbab9993 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:26.685077 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8eb73e84-8ed1-4d8f-9ad0-9960cbab9993 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:26.685838 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8eb73e84-8ed1-4d8f-9ad0-9960cbab9993 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:26.686271 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8eb73e84-8ed1-4d8f-9ad0-9960cbab9993 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:26.820752 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-8eb73e84-8ed1-4d8f-9ad0-9960cbab9993 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:26.828416 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-8eb73e84-8ed1-4d8f-9ad0-9960cbab9993 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 200 len: 1577 microversion: 2.1 time: 0.159471 May 26 12:49:26.829000 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 650/1290] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:49:26 2022] GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:27.846589 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-576e306a-f3a8-4a40-9fb9-6d7339204980 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:27.847195 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-576e306a-f3a8-4a40-9fb9-6d7339204980 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:27.853694 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-576e306a-f3a8-4a40-9fb9-6d7339204980 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:27.854141 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-576e306a-f3a8-4a40-9fb9-6d7339204980 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:27.855297 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-576e306a-f3a8-4a40-9fb9-6d7339204980 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:27.855855 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-576e306a-f3a8-4a40-9fb9-6d7339204980 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:27.987493 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-576e306a-f3a8-4a40-9fb9-6d7339204980 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:27.995075 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-576e306a-f3a8-4a40-9fb9-6d7339204980 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 200 len: 1577 microversion: 2.1 time: 0.152710 May 26 12:49:27.996212 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 641/1291] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:49:27 2022] GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:29.013754 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6faa0727-c1e7-41e9-bfac-826610aa4a4b tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:29.014372 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-6faa0727-c1e7-41e9-bfac-826610aa4a4b tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:29.020989 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6faa0727-c1e7-41e9-bfac-826610aa4a4b tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:29.021441 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6faa0727-c1e7-41e9-bfac-826610aa4a4b tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:29.022207 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6faa0727-c1e7-41e9-bfac-826610aa4a4b tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:29.022647 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6faa0727-c1e7-41e9-bfac-826610aa4a4b tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:29.158434 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-6faa0727-c1e7-41e9-bfac-826610aa4a4b tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:29.166070 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-6faa0727-c1e7-41e9-bfac-826610aa4a4b tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 200 len: 1577 microversion: 2.1 time: 0.157242 May 26 12:49:29.166635 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 651/1292] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:49:29 2022] GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:29.623400 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-f0d73096-1730-4481-bab5-d4c26893b8c4 req-3b346ab7-1417-4aea-8757-4d24c788f70a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a48ffb19-6386-4b90-93f7-16e01c3060da", "name": "network-vif-deleted", "tag": "adabefab-e666-411d-95db-a8e377570585"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:29.632228 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-f0d73096-1730-4481-bab5-d4c26893b8c4 req-3b346ab7-1417-4aea-8757-4d24c788f70a service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:29.632823 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-f0d73096-1730-4481-bab5-d4c26893b8c4 req-3b346ab7-1417-4aea-8757-4d24c788f70a service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:29.652782 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-f0d73096-1730-4481-bab5-d4c26893b8c4 req-3b346ab7-1417-4aea-8757-4d24c788f70a service nova] Creating event network-vif-deleted:adabefab-e666-411d-95db-a8e377570585 for instance a48ffb19-6386-4b90-93f7-16e01c3060da on hv-cinder-81514 May 26 12:49:29.657905 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-f0d73096-1730-4481-bab5-d4c26893b8c4 req-3b346ab7-1417-4aea-8757-4d24c788f70a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186591 May 26 12:49:29.658934 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 642/1293] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:49:30.182502 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-113f1351-79d0-4bd0-8cb0-11be567c2fb1 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:30.183557 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-113f1351-79d0-4bd0-8cb0-11be567c2fb1 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:30.189899 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-113f1351-79d0-4bd0-8cb0-11be567c2fb1 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:30.190345 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-113f1351-79d0-4bd0-8cb0-11be567c2fb1 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:30.191100 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-113f1351-79d0-4bd0-8cb0-11be567c2fb1 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:30.191535 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-113f1351-79d0-4bd0-8cb0-11be567c2fb1 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:30.225696 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-113f1351-79d0-4bd0-8cb0-11be567c2fb1 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:30.226152 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-113f1351-79d0-4bd0-8cb0-11be567c2fb1 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:30.226652 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.objects.instance [None req-113f1351-79d0-4bd0-8cb0-11be567c2fb1 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lazy-loading 'fault' on Instance uuid a48ffb19-6386-4b90-93f7-16e01c3060da {{(pid=124134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:49:30.269325 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-113f1351-79d0-4bd0-8cb0-11be567c2fb1 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:30.277583 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-113f1351-79d0-4bd0-8cb0-11be567c2fb1 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 200 len: 1230 microversion: 2.1 time: 0.098932 May 26 12:49:30.278162 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 652/1294] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:49:30 2022] GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:31.295916 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-8043f0a0-6d26-41ef-ac85-f3d8c0b5b5db tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:31.296609 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-8043f0a0-6d26-41ef-ac85-f3d8c0b5b5db tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:31.303395 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8043f0a0-6d26-41ef-ac85-f3d8c0b5b5db tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:31.303837 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8043f0a0-6d26-41ef-ac85-f3d8c0b5b5db tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:31.304594 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8043f0a0-6d26-41ef-ac85-f3d8c0b5b5db tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:31.305066 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-8043f0a0-6d26-41ef-ac85-f3d8c0b5b5db tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:31.319356 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-8043f0a0-6d26-41ef-ac85-f3d8c0b5b5db tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] HTTP exception thrown: Instance a48ffb19-6386-4b90-93f7-16e01c3060da could not be found. May 26 12:49:31.321037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-8043f0a0-6d26-41ef-ac85-f3d8c0b5b5db tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Request method failure captured: May 26 12:49:31.321037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da HTTP/1.1 May 26 12:49:31.321037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:49:31.321037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:49:31.321037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:49:31.321037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:49:31.321037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:49:31.321037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:49:31.321037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:49:31.321037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:49:31.321037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3Zt4hbvMPRvdCNfyDwoOT19efl3pWKFll6rlxgQbLkt3Sgh_MLfs2lM-eHco30QcYS3ojVobtky6VbPhD4AFF8g0TyFspwrKZpC8tmXTyPu1SybcPNd-K2yu4vnNAivN3-I_aozQhgm7N4aqGbZUAFHtN-dwbgWeRrQQLLi6GYMD28 May 26 12:49:31.321037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:49:31.321037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:49:31.321037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:49:31.321037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:49:31.321037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:49:31.321037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:49:31.321037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: 6113ad5a21fa49d6906e26db6cf348a3 May 26 12:49:31.321037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-TestVolumeBootPattern-806308970 May 26 12:49:31.321037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:49:31.321037 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:49:31.322710 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6113ad5a21fa49d6906e26db6cf348a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6113ad5a21fa49d6906e26db6cf348a3", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6113ad5a21fa49d6906e26db6cf348a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6113ad5a21fa49d6906e26db6cf348a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:49:31.322710 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-TestVolumeBootPattern-806308970 May 26 12:49:31.322710 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: 6113ad5a21fa49d6906e26db6cf348a3 May 26 12:49:31.322710 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-TestVolumeBootPattern-806308970 May 26 12:49:31.322710 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-TestVolumeBootPattern-806308970-project May 26 12:49:31.322710 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:49:31.322710 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:49:31.322710 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: 3c4e48e94f934a3baf6a09a2b2d8f85d May 26 12:49:31.322710 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-TestVolumeBootPattern-806308970-project May 26 12:49:31.322710 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: > May 26 12:49:31.322710 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Instance a48ffb19-6386-4b90-93f7-16e01c3060da could not be found. May 26 12:49:31.322710 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': 'a48ffb19-6386-4b90-93f7-16e01c3060da'} May 26 12:49:31.324160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:49:31.324160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:31.324160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:49:31.324160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:49:31.324160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:49:31.324160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:49:31.324160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:49:31.324160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:49:31.324160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:49:31.324160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:49:31.324160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48ffb19-6386-4b90-93f7-16e01c3060da could not be found. May 26 12:49:31.324160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:49:31.324160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:49:31.324160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:49:31.324160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:31.324160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:49:31.324160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:49:31.324160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:49:31.324160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:49:31.324160 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:49:31.325971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:49:31.325971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:49:31.325971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:49:31.325971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:49:31.325971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:49:31.325971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:49:31.325971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:49:31.325971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48ffb19-6386-4b90-93f7-16e01c3060da could not be found. May 26 12:49:31.325971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:49:31.325971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:49:31.325971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:49:31.325971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:31.325971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:49:31.325971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:49:31.325971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:49:31.325971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:49:31.325971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48ffb19-6386-4b90-93f7-16e01c3060da could not be found. May 26 12:49:31.325971 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:49:31.327466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-8043f0a0-6d26-41ef-ac85-f3d8c0b5b5db tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Returning 404 to user: Instance a48ffb19-6386-4b90-93f7-16e01c3060da could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:49:31.327466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-8043f0a0-6d26-41ef-ac85-f3d8c0b5b5db tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 404 len: 111 microversion: 2.1 time: 0.031491 May 26 12:49:31.327466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 643/1295] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:49:31 2022] GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:49:31.419914 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-603b946f-0c8a-41a6-bb38-e3c8be72ada5 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2062986829", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2095207375", "security_groups": [{"name": "tempest-secgroup-smoke-2046651539"}], "block_device_mapping_v2": [{"uuid": "caf79859-107c-41c3-8a4a-d9e4a9c7c7f3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cf1be97e-5e69-46c0-98a3-21a4f70a519f"}]}} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:31.529812 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.network.neutron [None req-603b946f-0c8a-41a6-bb38-e3c8be72ada5 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] validate_networks() for [('cf1be97e-5e69-46c0-98a3-21a4f70a519f', None, None, None, None, None)] {{(pid=124134) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:49:31.957097 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-603b946f-0c8a-41a6-bb38-e3c8be72ada5 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Flavor limits 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:49:31.957545 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-603b946f-0c8a-41a6-bb38-e3c8be72ada5 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Image limits 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:49:31.958016 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-603b946f-0c8a-41a6-bb38-e3c8be72ada5 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Flavor pref 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:49:31.958424 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-603b946f-0c8a-41a6-bb38-e3c8be72ada5 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Image pref 0:0:0 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:49:31.958835 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.virt.hardware [None req-603b946f-0c8a-41a6-bb38-e3c8be72ada5 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:49:31.967737 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-603b946f-0c8a-41a6-bb38-e3c8be72ada5 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:31.968182 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-603b946f-0c8a-41a6-bb38-e3c8be72ada5 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:31.969009 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-603b946f-0c8a-41a6-bb38-e3c8be72ada5 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:31.969448 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-603b946f-0c8a-41a6-bb38-e3c8be72ada5 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:31.986575 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.quota [None req-603b946f-0c8a-41a6-bb38-e3c8be72ada5 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Getting quotas for project 6113ad5a21fa49d6906e26db6cf348a3. Resources: {'cores', 'instances', 'ram'} {{(pid=124134) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:49:31.990499 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.quota [None req-603b946f-0c8a-41a6-bb38-e3c8be72ada5 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Getting quotas for user 3c4e48e94f934a3baf6a09a2b2d8f85d and project 6113ad5a21fa49d6906e26db6cf348a3. Resources: {'cores', 'instances', 'ram'} {{(pid=124134) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:49:32.048379 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-603b946f-0c8a-41a6-bb38-e3c8be72ada5 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Going to run 1 instances... {{(pid=124134) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:49:32.050508 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-603b946f-0c8a-41a6-bb38-e3c8be72ada5 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: 0268c5aa-8924-4b57-bdfe-6b818b4d4c52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='caf79859-107c-41c3-8a4a-d9e4a9c7c7f3',volume_size=None,volume_type=None)] {{(pid=124134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:49:32.184117 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-603b946f-0c8a-41a6-bb38-e3c8be72ada5 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.768677 May 26 12:49:32.184771 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 653/1296] 10.222.0.39 () {60 vars in 1146 bytes} [Thu May 26 12:49:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:49:32.194807 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ef574427-b840-4e58-9fa6-7046d4f0cd45 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:32.195418 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ef574427-b840-4e58-9fa6-7046d4f0cd45 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: 0268c5aa-8924-4b57-bdfe-6b818b4d4c52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:32.252040 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ef574427-b840-4e58-9fa6-7046d4f0cd45 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:32.258659 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ef574427-b840-4e58-9fa6-7046d4f0cd45 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52" status: 200 len: 1095 microversion: 2.1 time: 0.067623 May 26 12:49:32.259221 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 644/1297] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:49:32 2022] GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:49:33.276361 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-0a49a94a-936c-4ea7-a601-f52b24140859 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:33.276991 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-0a49a94a-936c-4ea7-a601-f52b24140859 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: 0268c5aa-8924-4b57-bdfe-6b818b4d4c52] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:33.284690 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0a49a94a-936c-4ea7-a601-f52b24140859 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:33.285322 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0a49a94a-936c-4ea7-a601-f52b24140859 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:33.286409 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0a49a94a-936c-4ea7-a601-f52b24140859 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:33.286612 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0a49a94a-936c-4ea7-a601-f52b24140859 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:33.360856 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-0a49a94a-936c-4ea7-a601-f52b24140859 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:33.370489 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-0a49a94a-936c-4ea7-a601-f52b24140859 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52" status: 200 len: 1201 microversion: 2.1 time: 0.098977 May 26 12:49:33.371828 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 654/1298] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:49:33 2022] GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52 => generated 1201 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:34.387505 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-0d5871e1-e169-41fc-8809-ae20ee46f3e4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:34.388120 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-0d5871e1-e169-41fc-8809-ae20ee46f3e4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: 0268c5aa-8924-4b57-bdfe-6b818b4d4c52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:34.395321 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0d5871e1-e169-41fc-8809-ae20ee46f3e4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:34.395769 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0d5871e1-e169-41fc-8809-ae20ee46f3e4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:34.396527 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0d5871e1-e169-41fc-8809-ae20ee46f3e4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:34.397002 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0d5871e1-e169-41fc-8809-ae20ee46f3e4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:34.537201 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-0d5871e1-e169-41fc-8809-ae20ee46f3e4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:34.545954 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-0d5871e1-e169-41fc-8809-ae20ee46f3e4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52" status: 200 len: 1267 microversion: 2.1 time: 0.162354 May 26 12:49:34.546535 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 645/1299] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:49:34 2022] GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:34.747793 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-f5ad52ce-3352-441b-9216-1c886fc18b6a req-b593caba-a8fa-4277-aea2-ac305088a879 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0268c5aa-8924-4b57-bdfe-6b818b4d4c52", "tag": "ce093c52-1d57-4f51-aea3-ea26c167d87d"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:34.756956 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-f5ad52ce-3352-441b-9216-1c886fc18b6a req-b593caba-a8fa-4277-aea2-ac305088a879 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:34.757648 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-f5ad52ce-3352-441b-9216-1c886fc18b6a req-b593caba-a8fa-4277-aea2-ac305088a879 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:34.777142 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-f5ad52ce-3352-441b-9216-1c886fc18b6a req-b593caba-a8fa-4277-aea2-ac305088a879 service nova] Creating event network-changed:ce093c52-1d57-4f51-aea3-ea26c167d87d for instance 0268c5aa-8924-4b57-bdfe-6b818b4d4c52 on hv-cinder-81514 May 26 12:49:34.782893 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-f5ad52ce-3352-441b-9216-1c886fc18b6a req-b593caba-a8fa-4277-aea2-ac305088a879 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040536 May 26 12:49:34.783849 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 655/1300] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:49:35.563780 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-2519bed5-d184-4c15-bdf7-39af11d04e0b tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:35.564325 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-2519bed5-d184-4c15-bdf7-39af11d04e0b tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: 0268c5aa-8924-4b57-bdfe-6b818b4d4c52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:35.570781 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2519bed5-d184-4c15-bdf7-39af11d04e0b tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:35.571229 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2519bed5-d184-4c15-bdf7-39af11d04e0b tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:35.571990 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2519bed5-d184-4c15-bdf7-39af11d04e0b tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:35.572426 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-2519bed5-d184-4c15-bdf7-39af11d04e0b tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:35.703904 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-2519bed5-d184-4c15-bdf7-39af11d04e0b tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:35.711466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-2519bed5-d184-4c15-bdf7-39af11d04e0b tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52" status: 200 len: 1267 microversion: 2.1 time: 0.151873 May 26 12:49:35.712033 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 646/1301] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:49:35 2022] GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:36.729140 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-d53dae24-e624-41e7-bc9c-39cf0bd0f6c2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:36.729748 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-d53dae24-e624-41e7-bc9c-39cf0bd0f6c2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: 0268c5aa-8924-4b57-bdfe-6b818b4d4c52] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:36.736607 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d53dae24-e624-41e7-bc9c-39cf0bd0f6c2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:36.737086 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d53dae24-e624-41e7-bc9c-39cf0bd0f6c2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:36.737835 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d53dae24-e624-41e7-bc9c-39cf0bd0f6c2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:36.738270 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d53dae24-e624-41e7-bc9c-39cf0bd0f6c2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:36.872972 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d53dae24-e624-41e7-bc9c-39cf0bd0f6c2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:36.881619 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-d53dae24-e624-41e7-bc9c-39cf0bd0f6c2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52" status: 200 len: 1267 microversion: 2.1 time: 0.157180 May 26 12:49:36.882199 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 656/1302] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:49:36 2022] GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:37.899076 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-b3409f2a-517c-4e66-ac61-d9dd0d4ff6ce tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:37.899702 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-b3409f2a-517c-4e66-ac61-d9dd0d4ff6ce tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: 0268c5aa-8924-4b57-bdfe-6b818b4d4c52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:37.907324 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b3409f2a-517c-4e66-ac61-d9dd0d4ff6ce tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:37.907781 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b3409f2a-517c-4e66-ac61-d9dd0d4ff6ce tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:37.908546 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b3409f2a-517c-4e66-ac61-d9dd0d4ff6ce tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:37.909015 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-b3409f2a-517c-4e66-ac61-d9dd0d4ff6ce tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:38.039751 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-b3409f2a-517c-4e66-ac61-d9dd0d4ff6ce tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:38.047176 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-b3409f2a-517c-4e66-ac61-d9dd0d4ff6ce tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52" status: 200 len: 1267 microversion: 2.1 time: 0.152081 May 26 12:49:38.047745 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 647/1303] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:49:37 2022] GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:39.063996 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-a0f9b0cf-9deb-42fb-b28c-4432fe3dc6cb tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:39.064604 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-a0f9b0cf-9deb-42fb-b28c-4432fe3dc6cb tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: 0268c5aa-8924-4b57-bdfe-6b818b4d4c52] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:39.070673 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a0f9b0cf-9deb-42fb-b28c-4432fe3dc6cb tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:39.071123 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a0f9b0cf-9deb-42fb-b28c-4432fe3dc6cb tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:39.071882 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a0f9b0cf-9deb-42fb-b28c-4432fe3dc6cb tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:39.072322 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a0f9b0cf-9deb-42fb-b28c-4432fe3dc6cb tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:39.202415 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a0f9b0cf-9deb-42fb-b28c-4432fe3dc6cb tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:39.209856 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-a0f9b0cf-9deb-42fb-b28c-4432fe3dc6cb tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52" status: 200 len: 1267 microversion: 2.1 time: 0.150343 May 26 12:49:39.210413 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 657/1304] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:49:39 2022] GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:40.227554 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-018534ad-ff85-4ce1-ae61-4931dc04c11d tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:40.228194 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-018534ad-ff85-4ce1-ae61-4931dc04c11d tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: 0268c5aa-8924-4b57-bdfe-6b818b4d4c52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:40.235816 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-018534ad-ff85-4ce1-ae61-4931dc04c11d tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:40.236259 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-018534ad-ff85-4ce1-ae61-4931dc04c11d tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:40.237047 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-018534ad-ff85-4ce1-ae61-4931dc04c11d tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:40.237482 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-018534ad-ff85-4ce1-ae61-4931dc04c11d tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:40.384487 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-018534ad-ff85-4ce1-ae61-4931dc04c11d tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:40.391894 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-018534ad-ff85-4ce1-ae61-4931dc04c11d tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52" status: 200 len: 1267 microversion: 2.1 time: 0.168162 May 26 12:49:40.392447 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 648/1305] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:49:40 2022] GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:41.409294 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-8522c2f0-e828-46a5-b4a4-2acb0f4ffbd4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:41.409903 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-8522c2f0-e828-46a5-b4a4-2acb0f4ffbd4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: 0268c5aa-8924-4b57-bdfe-6b818b4d4c52] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:41.416354 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8522c2f0-e828-46a5-b4a4-2acb0f4ffbd4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:41.416830 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8522c2f0-e828-46a5-b4a4-2acb0f4ffbd4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:41.417587 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8522c2f0-e828-46a5-b4a4-2acb0f4ffbd4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:41.418023 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-8522c2f0-e828-46a5-b4a4-2acb0f4ffbd4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:41.547744 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-8522c2f0-e828-46a5-b4a4-2acb0f4ffbd4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:41.555718 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-8522c2f0-e828-46a5-b4a4-2acb0f4ffbd4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52" status: 200 len: 1267 microversion: 2.1 time: 0.150223 May 26 12:49:41.556301 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 658/1306] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:49:41 2022] GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:42.574686 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-12a50e79-3bee-44c5-a61d-99773aedd7e1 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:42.576019 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-12a50e79-3bee-44c5-a61d-99773aedd7e1 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: 0268c5aa-8924-4b57-bdfe-6b818b4d4c52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:42.578477 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=2 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:42.583866 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-12a50e79-3bee-44c5-a61d-99773aedd7e1 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:42.584321 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-12a50e79-3bee-44c5-a61d-99773aedd7e1 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:42.585121 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-12a50e79-3bee-44c5-a61d-99773aedd7e1 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:42.585564 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-12a50e79-3bee-44c5-a61d-99773aedd7e1 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:42.717393 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-12a50e79-3bee-44c5-a61d-99773aedd7e1 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:42.724804 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-12a50e79-3bee-44c5-a61d-99773aedd7e1 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52" status: 200 len: 1267 microversion: 2.1 time: 0.154002 May 26 12:49:42.725365 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 649/1307] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:49:42 2022] GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:43.741518 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e9d8719b-8486-4cc5-8974-4979a1670ffa tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:43.742105 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-e9d8719b-8486-4cc5-8974-4979a1670ffa tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: 0268c5aa-8924-4b57-bdfe-6b818b4d4c52] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:43.744776 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell0:SELECT=2 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:43.745468 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell0:SELECT=6 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:43.753171 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e9d8719b-8486-4cc5-8974-4979a1670ffa tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:43.753620 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e9d8719b-8486-4cc5-8974-4979a1670ffa tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:43.754378 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e9d8719b-8486-4cc5-8974-4979a1670ffa tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:43.754809 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e9d8719b-8486-4cc5-8974-4979a1670ffa tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:43.883870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-e9d8719b-8486-4cc5-8974-4979a1670ffa tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:43.892071 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-e9d8719b-8486-4cc5-8974-4979a1670ffa tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52" status: 200 len: 1267 microversion: 2.1 time: 0.154322 May 26 12:49:43.892636 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 659/1308] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:49:43 2022] GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:44.909021 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-a0ac65d0-1393-4aaf-b3e9-84282f650555 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:44.909643 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-a0ac65d0-1393-4aaf-b3e9-84282f650555 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: 0268c5aa-8924-4b57-bdfe-6b818b4d4c52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:44.915981 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a0ac65d0-1393-4aaf-b3e9-84282f650555 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:44.916558 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a0ac65d0-1393-4aaf-b3e9-84282f650555 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:44.917364 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a0ac65d0-1393-4aaf-b3e9-84282f650555 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:44.917849 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a0ac65d0-1393-4aaf-b3e9-84282f650555 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:45.057571 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-a0ac65d0-1393-4aaf-b3e9-84282f650555 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:45.065495 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-a0ac65d0-1393-4aaf-b3e9-84282f650555 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52" status: 200 len: 1267 microversion: 2.1 time: 0.160740 May 26 12:49:45.066058 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 650/1309] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:49:44 2022] GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:45.128141 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-251e34b9-e267-4b02-b20d-3f69b1ffed52 req-ae681c14-0505-4f32-8d99-487442f94abe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0268c5aa-8924-4b57-bdfe-6b818b4d4c52", "name": "network-vif-plugged", "status": "completed", "tag": "ce093c52-1d57-4f51-aea3-ea26c167d87d"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:45.137311 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-251e34b9-e267-4b02-b20d-3f69b1ffed52 req-ae681c14-0505-4f32-8d99-487442f94abe service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:45.137855 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-251e34b9-e267-4b02-b20d-3f69b1ffed52 req-ae681c14-0505-4f32-8d99-487442f94abe service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:45.149797 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-251e34b9-e267-4b02-b20d-3f69b1ffed52 req-ae681c14-0505-4f32-8d99-487442f94abe service nova] Creating event network-vif-plugged:ce093c52-1d57-4f51-aea3-ea26c167d87d for instance 0268c5aa-8924-4b57-bdfe-6b818b4d4c52 on hv-cinder-81514 May 26 12:49:45.155810 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-251e34b9-e267-4b02-b20d-3f69b1ffed52 req-ae681c14-0505-4f32-8d99-487442f94abe service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031282 May 26 12:49:45.156515 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 660/1310] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:49:46.083223 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-e35a7547-5716-4a87-bbaf-444d10314274 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:46.083841 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-e35a7547-5716-4a87-bbaf-444d10314274 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: 0268c5aa-8924-4b57-bdfe-6b818b4d4c52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:46.090434 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e35a7547-5716-4a87-bbaf-444d10314274 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:46.090887 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e35a7547-5716-4a87-bbaf-444d10314274 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:46.091646 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e35a7547-5716-4a87-bbaf-444d10314274 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:46.092085 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-e35a7547-5716-4a87-bbaf-444d10314274 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:46.222204 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-e35a7547-5716-4a87-bbaf-444d10314274 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:46.229771 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-e35a7547-5716-4a87-bbaf-444d10314274 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52" status: 200 len: 1267 microversion: 2.1 time: 0.150675 May 26 12:49:46.230336 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 651/1311] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:49:46 2022] GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:47.247685 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-7fa16d7c-dc53-4e83-b6c6-9802f0d77f98 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:47.248382 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-7fa16d7c-dc53-4e83-b6c6-9802f0d77f98 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: 0268c5aa-8924-4b57-bdfe-6b818b4d4c52] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:47.255144 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7fa16d7c-dc53-4e83-b6c6-9802f0d77f98 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:47.255597 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7fa16d7c-dc53-4e83-b6c6-9802f0d77f98 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:47.256346 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7fa16d7c-dc53-4e83-b6c6-9802f0d77f98 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:47.256803 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-7fa16d7c-dc53-4e83-b6c6-9802f0d77f98 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:47.387584 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-7fa16d7c-dc53-4e83-b6c6-9802f0d77f98 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:47.395534 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-7fa16d7c-dc53-4e83-b6c6-9802f0d77f98 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52" status: 200 len: 1454 microversion: 2.1 time: 0.152560 May 26 12:49:47.396091 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 661/1312] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:49:47 2022] GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:47.412495 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-ea8425ab-0462-4aeb-adce-7b3ef1873b88 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:47.413137 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-ea8425ab-0462-4aeb-adce-7b3ef1873b88 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: 0268c5aa-8924-4b57-bdfe-6b818b4d4c52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:47.419515 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ea8425ab-0462-4aeb-adce-7b3ef1873b88 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:47.419969 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ea8425ab-0462-4aeb-adce-7b3ef1873b88 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:47.420745 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ea8425ab-0462-4aeb-adce-7b3ef1873b88 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:47.421455 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-ea8425ab-0462-4aeb-adce-7b3ef1873b88 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:47.554256 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-ea8425ab-0462-4aeb-adce-7b3ef1873b88 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:47.562500 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-ea8425ab-0462-4aeb-adce-7b3ef1873b88 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52" status: 200 len: 1454 microversion: 2.1 time: 0.153499 May 26 12:49:47.563132 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 652/1313] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:49:47 2022] GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:49.515894 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-cf13a97e-3901-456c-b473-88f1c3edeee2 req-7ec4c075-6a7f-41a3-9b7f-9fa039391327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0268c5aa-8924-4b57-bdfe-6b818b4d4c52", "tag": "ce093c52-1d57-4f51-aea3-ea26c167d87d"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:49.524531 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-cf13a97e-3901-456c-b473-88f1c3edeee2 req-7ec4c075-6a7f-41a3-9b7f-9fa039391327 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:49.524995 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-cf13a97e-3901-456c-b473-88f1c3edeee2 req-7ec4c075-6a7f-41a3-9b7f-9fa039391327 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:49.541669 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-cf13a97e-3901-456c-b473-88f1c3edeee2 req-7ec4c075-6a7f-41a3-9b7f-9fa039391327 service nova] Creating event network-changed:ce093c52-1d57-4f51-aea3-ea26c167d87d for instance 0268c5aa-8924-4b57-bdfe-6b818b4d4c52 on hv-cinder-81514 May 26 12:49:49.547405 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-cf13a97e-3901-456c-b473-88f1c3edeee2 req-7ec4c075-6a7f-41a3-9b7f-9fa039391327 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105265 May 26 12:49:49.548190 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 662/1314] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:58.162922 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:50:58.163550 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Thu May 26 12:50:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 12:51:36.301718 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:51:36.302546 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Thu May 26 12:51:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 12:52:04.266100 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:04.266849 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:04.271209 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-af2ec49d-6620-4f51-8b5c-36477ba300f0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-735597129", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2095207375", "security_groups": [{"name": "tempest-secgroup-smoke-2046651539"}], "block_device_mapping_v2": [{"uuid": "80a5278c-cc5e-4d39-b414-6514b2b20f36", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cf1be97e-5e69-46c0-98a3-21a4f70a519f"}]}} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:04.387420 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.network.neutron [None req-af2ec49d-6620-4f51-8b5c-36477ba300f0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] validate_networks() for [('cf1be97e-5e69-46c0-98a3-21a4f70a519f', None, None, None, None, None)] {{(pid=124133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:52:04.799359 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-af2ec49d-6620-4f51-8b5c-36477ba300f0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Flavor limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:52:04.799788 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-af2ec49d-6620-4f51-8b5c-36477ba300f0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Image limits 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:52:04.800266 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-af2ec49d-6620-4f51-8b5c-36477ba300f0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Flavor pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:52:04.800681 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-af2ec49d-6620-4f51-8b5c-36477ba300f0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Image pref 0:0:0 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:52:04.801122 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.virt.hardware [None req-af2ec49d-6620-4f51-8b5c-36477ba300f0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:52:04.810998 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-af2ec49d-6620-4f51-8b5c-36477ba300f0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:04.811455 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-af2ec49d-6620-4f51-8b5c-36477ba300f0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:04.812259 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-af2ec49d-6620-4f51-8b5c-36477ba300f0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:04.812701 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-af2ec49d-6620-4f51-8b5c-36477ba300f0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:04.830725 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-af2ec49d-6620-4f51-8b5c-36477ba300f0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Getting quotas for project 6113ad5a21fa49d6906e26db6cf348a3. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:52:04.834812 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.quota [None req-af2ec49d-6620-4f51-8b5c-36477ba300f0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Getting quotas for user 3c4e48e94f934a3baf6a09a2b2d8f85d and project 6113ad5a21fa49d6906e26db6cf348a3. Resources: {'cores', 'instances', 'ram'} {{(pid=124133) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:52:04.894318 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-af2ec49d-6620-4f51-8b5c-36477ba300f0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Going to run 1 instances... {{(pid=124133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:52:04.896607 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-af2ec49d-6620-4f51-8b5c-36477ba300f0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: f8b4f1e9-93a4-4aa9-97e0-398126621e15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='80a5278c-cc5e-4d39-b414-6514b2b20f36',volume_size=None,volume_type=None)] {{(pid=124133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:52:05.035598 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR oslo.messaging._drivers.impl_rabbit [None req-af2ec49d-6620-4f51-8b5c-36477ba300f0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [0a76e9e8-bcc2-41c5-8ca2-3cc2414f582d] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 12:52:06.043865 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO oslo.messaging._drivers.impl_rabbit [None req-af2ec49d-6620-4f51-8b5c-36477ba300f0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [0a76e9e8-bcc2-41c5-8ca2-3cc2414f582d] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 35706. May 26 12:52:06.047579 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-af2ec49d-6620-4f51-8b5c-36477ba300f0 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.783347 May 26 12:52:06.048218 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 653/1315] 10.222.0.39 () {60 vars in 1146 bytes} [Thu May 26 12:52:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:52:06.056566 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c353308c-70e2-4e9a-8d79-ce55bb1d827e] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 12:52:06.057226 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:06.058118 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=64 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:06.062578 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-de0083c3-83d9-4477-97ce-9ae04a65aebe tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:06.063393 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-de0083c3-83d9-4477-97ce-9ae04a65aebe tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: f8b4f1e9-93a4-4aa9-97e0-398126621e15] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:06.119411 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-de0083c3-83d9-4477-97ce-9ae04a65aebe tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:06.126169 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-de0083c3-83d9-4477-97ce-9ae04a65aebe tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15" status: 200 len: 1094 microversion: 2.1 time: 0.071405 May 26 12:52:06.126717 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 663/1316] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:52:06 2022] GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:07.144077 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-8c7cd6d4-c9d3-4cc2-8042-cad293108168 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:07.144600 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-8c7cd6d4-c9d3-4cc2-8042-cad293108168 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: f8b4f1e9-93a4-4aa9-97e0-398126621e15] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:07.199645 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-8c7cd6d4-c9d3-4cc2-8042-cad293108168 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:07.206404 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-8c7cd6d4-c9d3-4cc2-8042-cad293108168 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15" status: 200 len: 1094 microversion: 2.1 time: 0.066751 May 26 12:52:07.206963 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 654/1317] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:52:07 2022] GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:08.223099 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-15511282-da3c-4f04-9bdb-a3a994a181d4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:08.223699 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-15511282-da3c-4f04-9bdb-a3a994a181d4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: f8b4f1e9-93a4-4aa9-97e0-398126621e15] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:08.249591 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO oslo.messaging._drivers.impl_rabbit [-] [c353308c-70e2-4e9a-8d79-ce55bb1d827e] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 35726. May 26 12:52:08.284293 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-15511282-da3c-4f04-9bdb-a3a994a181d4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:08.292005 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-15511282-da3c-4f04-9bdb-a3a994a181d4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15" status: 200 len: 1094 microversion: 2.1 time: 0.072740 May 26 12:52:08.292565 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 664/1318] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:52:08 2022] GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:09.309455 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-486c318a-a029-4a43-93f0-5e1d3fc026d8 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:09.310062 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-486c318a-a029-4a43-93f0-5e1d3fc026d8 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: f8b4f1e9-93a4-4aa9-97e0-398126621e15] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:09.367240 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-486c318a-a029-4a43-93f0-5e1d3fc026d8 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:09.374156 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-486c318a-a029-4a43-93f0-5e1d3fc026d8 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15" status: 200 len: 1094 microversion: 2.1 time: 0.068515 May 26 12:52:09.374722 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 655/1319] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:52:09 2022] GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:10.391480 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-a8584bc2-9a06-4916-87f3-9c612891daf8 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:10.392090 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-a8584bc2-9a06-4916-87f3-9c612891daf8 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: f8b4f1e9-93a4-4aa9-97e0-398126621e15] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:10.400910 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a8584bc2-9a06-4916-87f3-9c612891daf8 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:10.401390 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a8584bc2-9a06-4916-87f3-9c612891daf8 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:10.402512 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a8584bc2-9a06-4916-87f3-9c612891daf8 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:10.403296 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-a8584bc2-9a06-4916-87f3-9c612891daf8 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:10.465458 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-a8584bc2-9a06-4916-87f3-9c612891daf8 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:10.473228 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-a8584bc2-9a06-4916-87f3-9c612891daf8 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15" status: 200 len: 1144 microversion: 2.1 time: 0.085642 May 26 12:52:10.473799 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 665/1320] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:52:10 2022] GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15 => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:11.491577 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-204e534e-cecf-416a-b381-2b0c94ea75bf tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:11.492205 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-204e534e-cecf-416a-b381-2b0c94ea75bf tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: f8b4f1e9-93a4-4aa9-97e0-398126621e15] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:11.499468 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-204e534e-cecf-416a-b381-2b0c94ea75bf tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:11.499929 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-204e534e-cecf-416a-b381-2b0c94ea75bf tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:11.500708 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-204e534e-cecf-416a-b381-2b0c94ea75bf tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:11.501175 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-204e534e-cecf-416a-b381-2b0c94ea75bf tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:11.565240 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-204e534e-cecf-416a-b381-2b0c94ea75bf tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:11.573962 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-204e534e-cecf-416a-b381-2b0c94ea75bf tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15" status: 200 len: 1210 microversion: 2.1 time: 0.086777 May 26 12:52:11.574536 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 656/1321] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:52:11 2022] GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:12.553943 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-ce8d81a4-f071-4fb9-a108-4b88fd38f2b9 req-dd1d0326-eb39-4e82-9bc6-4ea1a2b757fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8b4f1e9-93a4-4aa9-97e0-398126621e15", "tag": "45663ba1-4ac4-4d80-a772-b6e21b67032e"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:12.565829 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-ce8d81a4-f071-4fb9-a108-4b88fd38f2b9 req-dd1d0326-eb39-4e82-9bc6-4ea1a2b757fd service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:12.566517 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-ce8d81a4-f071-4fb9-a108-4b88fd38f2b9 req-dd1d0326-eb39-4e82-9bc6-4ea1a2b757fd service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:12.591576 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f4e09af2-88e1-4a0d-8e57-412cbbd661d4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:12.592894 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f4e09af2-88e1-4a0d-8e57-412cbbd661d4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: f8b4f1e9-93a4-4aa9-97e0-398126621e15] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:12.594842 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-ce8d81a4-f071-4fb9-a108-4b88fd38f2b9 req-dd1d0326-eb39-4e82-9bc6-4ea1a2b757fd service nova] Creating event network-changed:45663ba1-4ac4-4d80-a772-b6e21b67032e for instance f8b4f1e9-93a4-4aa9-97e0-398126621e15 on hv-cinder-81514 May 26 12:52:12.601817 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-ce8d81a4-f071-4fb9-a108-4b88fd38f2b9 req-dd1d0326-eb39-4e82-9bc6-4ea1a2b757fd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051895 May 26 12:52:12.602996 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 666/1322] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:52:12.613232 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f4e09af2-88e1-4a0d-8e57-412cbbd661d4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:12.613779 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f4e09af2-88e1-4a0d-8e57-412cbbd661d4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:12.614784 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f4e09af2-88e1-4a0d-8e57-412cbbd661d4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:12.615427 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f4e09af2-88e1-4a0d-8e57-412cbbd661d4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:12.765510 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-f4e09af2-88e1-4a0d-8e57-412cbbd661d4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:12.774077 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f4e09af2-88e1-4a0d-8e57-412cbbd661d4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15" status: 200 len: 1266 microversion: 2.1 time: 0.186753 May 26 12:52:12.774649 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 657/1323] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:52:12 2022] GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:52:13.792838 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-270fab3b-f0c6-4f52-b546-e93027a17f8f tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:13.793632 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-270fab3b-f0c6-4f52-b546-e93027a17f8f tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: f8b4f1e9-93a4-4aa9-97e0-398126621e15] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:13.801234 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-270fab3b-f0c6-4f52-b546-e93027a17f8f tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:13.801689 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-270fab3b-f0c6-4f52-b546-e93027a17f8f tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:13.803260 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-270fab3b-f0c6-4f52-b546-e93027a17f8f tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:13.803893 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-270fab3b-f0c6-4f52-b546-e93027a17f8f tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:13.937058 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-270fab3b-f0c6-4f52-b546-e93027a17f8f tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:13.944635 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-270fab3b-f0c6-4f52-b546-e93027a17f8f tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15" status: 200 len: 1266 microversion: 2.1 time: 0.156077 May 26 12:52:13.945229 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 667/1324] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:52:13 2022] GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:14.962028 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-dd645d28-bc19-4178-9e88-e18e5931e749 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:14.962638 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-dd645d28-bc19-4178-9e88-e18e5931e749 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: f8b4f1e9-93a4-4aa9-97e0-398126621e15] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:14.964466 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=2 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:14.970056 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dd645d28-bc19-4178-9e88-e18e5931e749 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:14.970507 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dd645d28-bc19-4178-9e88-e18e5931e749 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:14.971262 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dd645d28-bc19-4178-9e88-e18e5931e749 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:14.971699 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dd645d28-bc19-4178-9e88-e18e5931e749 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:15.105031 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-dd645d28-bc19-4178-9e88-e18e5931e749 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:15.112483 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-dd645d28-bc19-4178-9e88-e18e5931e749 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15" status: 200 len: 1266 microversion: 2.1 time: 0.154958 May 26 12:52:15.113082 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 658/1325] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:52:14 2022] GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:16.129762 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-d854da90-9b5c-4d54-969c-26fb42593723 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:16.130955 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-d854da90-9b5c-4d54-969c-26fb42593723 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: f8b4f1e9-93a4-4aa9-97e0-398126621e15] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:16.137793 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d854da90-9b5c-4d54-969c-26fb42593723 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:16.138176 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d854da90-9b5c-4d54-969c-26fb42593723 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:16.138933 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d854da90-9b5c-4d54-969c-26fb42593723 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:16.139367 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-d854da90-9b5c-4d54-969c-26fb42593723 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:16.272870 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-d854da90-9b5c-4d54-969c-26fb42593723 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:16.280745 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-d854da90-9b5c-4d54-969c-26fb42593723 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15" status: 200 len: 1266 microversion: 2.1 time: 0.154733 May 26 12:52:16.281517 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 668/1326] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:52:16 2022] GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:17.298574 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-61861e6f-6e23-47a2-99c6-8fd1d19e6312 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:17.299201 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-61861e6f-6e23-47a2-99c6-8fd1d19e6312 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: f8b4f1e9-93a4-4aa9-97e0-398126621e15] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:17.306313 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-61861e6f-6e23-47a2-99c6-8fd1d19e6312 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:17.306771 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-61861e6f-6e23-47a2-99c6-8fd1d19e6312 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:17.307539 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-61861e6f-6e23-47a2-99c6-8fd1d19e6312 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:17.307981 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-61861e6f-6e23-47a2-99c6-8fd1d19e6312 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:17.439400 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-61861e6f-6e23-47a2-99c6-8fd1d19e6312 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:17.447524 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-61861e6f-6e23-47a2-99c6-8fd1d19e6312 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15" status: 200 len: 1266 microversion: 2.1 time: 0.152848 May 26 12:52:17.448079 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 659/1327] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:52:17 2022] GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:18.464273 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-e2d79f86-eedc-46a5-b6ce-41bd5ddc04fd tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:18.464907 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-e2d79f86-eedc-46a5-b6ce-41bd5ddc04fd tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: f8b4f1e9-93a4-4aa9-97e0-398126621e15] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:18.467342 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell0:SELECT=4 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:18.472971 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e2d79f86-eedc-46a5-b6ce-41bd5ddc04fd tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:18.473449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e2d79f86-eedc-46a5-b6ce-41bd5ddc04fd tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:18.475176 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e2d79f86-eedc-46a5-b6ce-41bd5ddc04fd tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:18.475649 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-e2d79f86-eedc-46a5-b6ce-41bd5ddc04fd tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:18.617435 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-e2d79f86-eedc-46a5-b6ce-41bd5ddc04fd tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:18.624935 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-e2d79f86-eedc-46a5-b6ce-41bd5ddc04fd tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15" status: 200 len: 1266 microversion: 2.1 time: 0.164489 May 26 12:52:18.625495 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 669/1328] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:52:18 2022] GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:19.641711 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-dc18d672-445a-4901-91a1-204bf6f185e4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:19.642274 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-dc18d672-445a-4901-91a1-204bf6f185e4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: f8b4f1e9-93a4-4aa9-97e0-398126621e15] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:19.644556 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell0:SELECT=10 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:19.651191 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dc18d672-445a-4901-91a1-204bf6f185e4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:19.651647 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dc18d672-445a-4901-91a1-204bf6f185e4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:19.652413 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dc18d672-445a-4901-91a1-204bf6f185e4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:19.652889 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-dc18d672-445a-4901-91a1-204bf6f185e4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:19.784306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-dc18d672-445a-4901-91a1-204bf6f185e4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:19.791798 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-dc18d672-445a-4901-91a1-204bf6f185e4 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15" status: 200 len: 1266 microversion: 2.1 time: 0.154056 May 26 12:52:19.792354 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 660/1329] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:52:19 2022] GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:20.808935 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-da49c94f-7fdc-4fbc-9e48-86e18057df5f tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:20.809549 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-da49c94f-7fdc-4fbc-9e48-86e18057df5f tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: f8b4f1e9-93a4-4aa9-97e0-398126621e15] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:20.816248 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-da49c94f-7fdc-4fbc-9e48-86e18057df5f tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:20.816695 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-da49c94f-7fdc-4fbc-9e48-86e18057df5f tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:20.818219 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-da49c94f-7fdc-4fbc-9e48-86e18057df5f tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:20.818659 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-da49c94f-7fdc-4fbc-9e48-86e18057df5f tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:20.962740 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-da49c94f-7fdc-4fbc-9e48-86e18057df5f tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:20.970609 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-da49c94f-7fdc-4fbc-9e48-86e18057df5f tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15" status: 200 len: 1266 microversion: 2.1 time: 0.165532 May 26 12:52:20.971185 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 670/1330] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:52:20 2022] GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:21.991184 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-aca139d8-62f3-4d8b-8a14-c2a32de7aa7e tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:21.991799 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-aca139d8-62f3-4d8b-8a14-c2a32de7aa7e tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: f8b4f1e9-93a4-4aa9-97e0-398126621e15] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:21.998152 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-aca139d8-62f3-4d8b-8a14-c2a32de7aa7e tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:21.998606 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-aca139d8-62f3-4d8b-8a14-c2a32de7aa7e tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:21.999371 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-aca139d8-62f3-4d8b-8a14-c2a32de7aa7e tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:21.999806 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-aca139d8-62f3-4d8b-8a14-c2a32de7aa7e tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:22.128619 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-aca139d8-62f3-4d8b-8a14-c2a32de7aa7e tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:22.136319 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-aca139d8-62f3-4d8b-8a14-c2a32de7aa7e tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15" status: 200 len: 1266 microversion: 2.1 time: 0.150601 May 26 12:52:22.136828 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 661/1331] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:52:21 2022] GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:23.155709 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b2d5cf79-b8bc-40b2-a535-986ed8b73b50 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:23.156351 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-b2d5cf79-b8bc-40b2-a535-986ed8b73b50 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: f8b4f1e9-93a4-4aa9-97e0-398126621e15] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:23.163523 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b2d5cf79-b8bc-40b2-a535-986ed8b73b50 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:23.163985 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b2d5cf79-b8bc-40b2-a535-986ed8b73b50 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:23.164752 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b2d5cf79-b8bc-40b2-a535-986ed8b73b50 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:23.165187 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-b2d5cf79-b8bc-40b2-a535-986ed8b73b50 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:23.300890 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-b2d5cf79-b8bc-40b2-a535-986ed8b73b50 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:23.308528 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b2d5cf79-b8bc-40b2-a535-986ed8b73b50 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15" status: 200 len: 1266 microversion: 2.1 time: 0.156776 May 26 12:52:23.309143 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 671/1332] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:52:23 2022] GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:23.987924 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-584ec52b-1d3b-481c-a6db-d746c050998e req-48f217bb-c9d4-4d01-b884-44281f3ad381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8b4f1e9-93a4-4aa9-97e0-398126621e15", "name": "network-vif-plugged", "status": "completed", "tag": "45663ba1-4ac4-4d80-a772-b6e21b67032e"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:23.997118 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-584ec52b-1d3b-481c-a6db-d746c050998e req-48f217bb-c9d4-4d01-b884-44281f3ad381 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:23.997567 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-584ec52b-1d3b-481c-a6db-d746c050998e req-48f217bb-c9d4-4d01-b884-44281f3ad381 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:24.009720 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-584ec52b-1d3b-481c-a6db-d746c050998e req-48f217bb-c9d4-4d01-b884-44281f3ad381 service nova] Creating event network-vif-plugged:45663ba1-4ac4-4d80-a772-b6e21b67032e for instance f8b4f1e9-93a4-4aa9-97e0-398126621e15 on hv-cinder-81514 May 26 12:52:24.014689 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-584ec52b-1d3b-481c-a6db-d746c050998e req-48f217bb-c9d4-4d01-b884-44281f3ad381 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089309 May 26 12:52:24.015276 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 662/1333] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:52:24.325077 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-9c9dcd6c-65af-4ce6-9a06-fbe0f54e63ea tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:24.325784 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-9c9dcd6c-65af-4ce6-9a06-fbe0f54e63ea tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: f8b4f1e9-93a4-4aa9-97e0-398126621e15] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:24.332470 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9c9dcd6c-65af-4ce6-9a06-fbe0f54e63ea tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:24.333862 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9c9dcd6c-65af-4ce6-9a06-fbe0f54e63ea tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:24.334734 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9c9dcd6c-65af-4ce6-9a06-fbe0f54e63ea tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:24.335179 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-9c9dcd6c-65af-4ce6-9a06-fbe0f54e63ea tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:24.469968 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-9c9dcd6c-65af-4ce6-9a06-fbe0f54e63ea tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:24.477892 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-9c9dcd6c-65af-4ce6-9a06-fbe0f54e63ea tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15" status: 200 len: 1266 microversion: 2.1 time: 0.156794 May 26 12:52:24.478450 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 672/1334] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:52:24 2022] GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:25.496228 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-1ee07dd1-2c76-4632-946a-f4fdd3f9e630 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:25.496953 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-1ee07dd1-2c76-4632-946a-f4fdd3f9e630 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: f8b4f1e9-93a4-4aa9-97e0-398126621e15] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:25.503100 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1ee07dd1-2c76-4632-946a-f4fdd3f9e630 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:25.503542 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1ee07dd1-2c76-4632-946a-f4fdd3f9e630 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:25.504289 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1ee07dd1-2c76-4632-946a-f4fdd3f9e630 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:25.505351 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-1ee07dd1-2c76-4632-946a-f4fdd3f9e630 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:25.682315 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-1ee07dd1-2c76-4632-946a-f4fdd3f9e630 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:25.689742 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-1ee07dd1-2c76-4632-946a-f4fdd3f9e630 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15" status: 200 len: 1266 microversion: 2.1 time: 0.198371 May 26 12:52:25.690306 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 663/1335] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:52:25 2022] GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:52:26.706939 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6b06945d-23c2-4a9c-9819-24309be3fafb tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:26.707542 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-6b06945d-23c2-4a9c-9819-24309be3fafb tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: f8b4f1e9-93a4-4aa9-97e0-398126621e15] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:26.714865 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6b06945d-23c2-4a9c-9819-24309be3fafb tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:26.715310 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6b06945d-23c2-4a9c-9819-24309be3fafb tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:26.716067 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6b06945d-23c2-4a9c-9819-24309be3fafb tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:26.716499 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6b06945d-23c2-4a9c-9819-24309be3fafb tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:26.931295 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-6b06945d-23c2-4a9c-9819-24309be3fafb tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:26.939850 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-6b06945d-23c2-4a9c-9819-24309be3fafb tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15" status: 200 len: 1453 microversion: 2.1 time: 0.236806 May 26 12:52:26.940422 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 673/1336] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:52:26 2022] GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15 => generated 1453 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:26.958333 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-62cb3493-6ada-4478-ba4a-e913e5b7473c tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:26.958991 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-62cb3493-6ada-4478-ba4a-e913e5b7473c tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: f8b4f1e9-93a4-4aa9-97e0-398126621e15] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:26.967299 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-62cb3493-6ada-4478-ba4a-e913e5b7473c tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:26.967748 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-62cb3493-6ada-4478-ba4a-e913e5b7473c tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:26.968514 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-62cb3493-6ada-4478-ba4a-e913e5b7473c tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:26.968975 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-62cb3493-6ada-4478-ba4a-e913e5b7473c tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:27.110978 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-62cb3493-6ada-4478-ba4a-e913e5b7473c tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:27.120742 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-62cb3493-6ada-4478-ba4a-e913e5b7473c tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15" status: 200 len: 1453 microversion: 2.1 time: 0.167074 May 26 12:52:27.121321 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 664/1337] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:52:26 2022] GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15 => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:28.737382 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:52:28.737982 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Thu May 26 12:52:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 12:52:29.197625 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-d0df4ee6-6820-4780-88a8-d1d7e4cd4912 req-c34cc88b-faf5-476e-9648-159badc42d5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8b4f1e9-93a4-4aa9-97e0-398126621e15", "tag": "45663ba1-4ac4-4d80-a772-b6e21b67032e"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:29.209064 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-d0df4ee6-6820-4780-88a8-d1d7e4cd4912 req-c34cc88b-faf5-476e-9648-159badc42d5e service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:29.209524 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-d0df4ee6-6820-4780-88a8-d1d7e4cd4912 req-c34cc88b-faf5-476e-9648-159badc42d5e service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:29.222391 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-d0df4ee6-6820-4780-88a8-d1d7e4cd4912 req-c34cc88b-faf5-476e-9648-159badc42d5e service nova] Creating event network-changed:45663ba1-4ac4-4d80-a772-b6e21b67032e for instance f8b4f1e9-93a4-4aa9-97e0-398126621e15 on hv-cinder-81514 May 26 12:52:29.228406 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-d0df4ee6-6820-4780-88a8-d1d7e4cd4912 req-c34cc88b-faf5-476e-9648-159badc42d5e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037162 May 26 12:52:29.229050 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 674/1338] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:54:18.172357 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:54:18.172999 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Thu May 26 12:54:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 12:54:30.214929 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9773fb98-5c1a-4d4f-b3c8-d58d7e66717b] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 26 12:54:30.215649 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:30.216559 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG dbcounter [-] [124133] Writing DB stats nova_cell1:SELECT=52 {{(pid=124133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:30.217608 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_api:SELECT=28 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:30.218442 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG dbcounter [-] [124134] Writing DB stats nova_cell1:SELECT=52 {{(pid=124134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:30.221862 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-0ed3d543-c07f-41ba-ab39-1264200e8f38 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:30.222587 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-0ed3d543-c07f-41ba-ab39-1264200e8f38 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: f8b4f1e9-93a4-4aa9-97e0-398126621e15] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:30.231533 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0ed3d543-c07f-41ba-ab39-1264200e8f38 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:30.232449 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0ed3d543-c07f-41ba-ab39-1264200e8f38 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:30.233280 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0ed3d543-c07f-41ba-ab39-1264200e8f38 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:30.233729 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-0ed3d543-c07f-41ba-ab39-1264200e8f38 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:30.262024 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-0ed3d543-c07f-41ba-ab39-1264200e8f38 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: f8b4f1e9-93a4-4aa9-97e0-398126621e15] Going to try to terminate instance {{(pid=124133) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:54:30.286359 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [req-34f9bc17-8fd3-4c34-aeaf-70496c6d8bfc req-44d4cea6-1e69-48fa-952a-85e3050fb6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8b4f1e9-93a4-4aa9-97e0-398126621e15", "tag": "45663ba1-4ac4-4d80-a772-b6e21b67032e"}]} {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:30.294986 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-34f9bc17-8fd3-4c34-aeaf-70496c6d8bfc req-44d4cea6-1e69-48fa-952a-85e3050fb6c6 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:30.295428 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [req-34f9bc17-8fd3-4c34-aeaf-70496c6d8bfc req-44d4cea6-1e69-48fa-952a-85e3050fb6c6 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:30.307817 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.compute.server_external_events [req-34f9bc17-8fd3-4c34-aeaf-70496c6d8bfc req-44d4cea6-1e69-48fa-952a-85e3050fb6c6 service nova] Creating event network-changed:45663ba1-4ac4-4d80-a772-b6e21b67032e for instance f8b4f1e9-93a4-4aa9-97e0-398126621e15 on hv-cinder-81514 May 26 12:54:30.313209 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [req-34f9bc17-8fd3-4c34-aeaf-70496c6d8bfc req-44d4cea6-1e69-48fa-952a-85e3050fb6c6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097788 May 26 12:54:30.314351 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 675/1339] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:54:30.347389 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-0ed3d543-c07f-41ba-ab39-1264200e8f38 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15" status: 204 len: 0 microversion: 2.1 time: 0.134447 May 26 12:54:30.348175 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 665/1340] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:54:30 2022] DELETE /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:54:30.357307 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-f77f54fe-68a5-4baa-b4ff-2e301ea5a64a tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:30.358364 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-f77f54fe-68a5-4baa-b4ff-2e301ea5a64a tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: f8b4f1e9-93a4-4aa9-97e0-398126621e15] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:30.366677 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f77f54fe-68a5-4baa-b4ff-2e301ea5a64a tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:30.367130 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f77f54fe-68a5-4baa-b4ff-2e301ea5a64a tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:30.367899 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f77f54fe-68a5-4baa-b4ff-2e301ea5a64a tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:30.368538 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-f77f54fe-68a5-4baa-b4ff-2e301ea5a64a tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:30.542658 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-f77f54fe-68a5-4baa-b4ff-2e301ea5a64a tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:30.551009 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-f77f54fe-68a5-4baa-b4ff-2e301ea5a64a tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15" status: 200 len: 1578 microversion: 2.1 time: 0.198129 May 26 12:54:30.552763 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 676/1341] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:54:30 2022] GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15 => generated 1578 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:54:31.571051 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-7b0b8375-b036-4fb6-a022-1716afcbb4d2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:31.571857 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-7b0b8375-b036-4fb6-a022-1716afcbb4d2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: f8b4f1e9-93a4-4aa9-97e0-398126621e15] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:31.584812 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO oslo.messaging._drivers.impl_rabbit [-] [9773fb98-5c1a-4d4f-b3c8-d58d7e66717b] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 35844. May 26 12:54:31.586423 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7b0b8375-b036-4fb6-a022-1716afcbb4d2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:31.586872 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7b0b8375-b036-4fb6-a022-1716afcbb4d2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:31.587636 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7b0b8375-b036-4fb6-a022-1716afcbb4d2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:31.588072 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-7b0b8375-b036-4fb6-a022-1716afcbb4d2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:31.733830 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-7b0b8375-b036-4fb6-a022-1716afcbb4d2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:31.741488 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-7b0b8375-b036-4fb6-a022-1716afcbb4d2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15" status: 200 len: 1578 microversion: 2.1 time: 0.175550 May 26 12:54:31.742052 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 666/1342] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:54:31 2022] GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15 => generated 1578 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:32.767938 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-21fce095-09ae-4566-8d9b-999c7e91aa13 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:32.769339 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-21fce095-09ae-4566-8d9b-999c7e91aa13 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: f8b4f1e9-93a4-4aa9-97e0-398126621e15] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:32.780404 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-21fce095-09ae-4566-8d9b-999c7e91aa13 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:32.780914 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-21fce095-09ae-4566-8d9b-999c7e91aa13 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:32.781702 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-21fce095-09ae-4566-8d9b-999c7e91aa13 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:32.782248 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-21fce095-09ae-4566-8d9b-999c7e91aa13 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:32.799449 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-8c39e56f-0e27-4da0-8338-c7a00dc0ef74 req-e1bcee81-16d1-461f-aecd-a82c3ad91c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8b4f1e9-93a4-4aa9-97e0-398126621e15", "name": "network-vif-deleted", "tag": "45663ba1-4ac4-4d80-a772-b6e21b67032e"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:32.809861 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-8c39e56f-0e27-4da0-8338-c7a00dc0ef74 req-e1bcee81-16d1-461f-aecd-a82c3ad91c2c service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:32.810260 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-8c39e56f-0e27-4da0-8338-c7a00dc0ef74 req-e1bcee81-16d1-461f-aecd-a82c3ad91c2c service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:32.823083 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-8c39e56f-0e27-4da0-8338-c7a00dc0ef74 req-e1bcee81-16d1-461f-aecd-a82c3ad91c2c service nova] Creating event network-vif-deleted:45663ba1-4ac4-4d80-a772-b6e21b67032e for instance f8b4f1e9-93a4-4aa9-97e0-398126621e15 on hv-cinder-81514 May 26 12:54:32.827933 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-8c39e56f-0e27-4da0-8338-c7a00dc0ef74 req-e1bcee81-16d1-461f-aecd-a82c3ad91c2c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032227 May 26 12:54:32.828616 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 667/1343] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:54:32.865371 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-21fce095-09ae-4566-8d9b-999c7e91aa13 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:32.872982 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-21fce095-09ae-4566-8d9b-999c7e91aa13 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15" status: 200 len: 1391 microversion: 2.1 time: 0.117464 May 26 12:54:32.873547 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 677/1344] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:54:32 2022] GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15 => generated 1391 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:33.891765 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f2b4b84f-46bc-4781-b7ab-38f29d42e8ad tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:33.892470 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-f2b4b84f-46bc-4781-b7ab-38f29d42e8ad tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: f8b4f1e9-93a4-4aa9-97e0-398126621e15] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:33.899643 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f2b4b84f-46bc-4781-b7ab-38f29d42e8ad tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:33.900377 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f2b4b84f-46bc-4781-b7ab-38f29d42e8ad tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:33.901161 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f2b4b84f-46bc-4781-b7ab-38f29d42e8ad tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:33.901600 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-f2b4b84f-46bc-4781-b7ab-38f29d42e8ad tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:33.918123 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-f2b4b84f-46bc-4781-b7ab-38f29d42e8ad tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] HTTP exception thrown: Instance f8b4f1e9-93a4-4aa9-97e0-398126621e15 could not be found. May 26 12:54:33.919769 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f2b4b84f-46bc-4781-b7ab-38f29d42e8ad tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Request method failure captured: May 26 12:54:33.919769 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15 HTTP/1.1 May 26 12:54:33.919769 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:54:33.919769 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:54:33.919769 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:54:33.919769 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:54:33.919769 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:54:33.919769 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:54:33.919769 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:54:33.919769 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:54:33.919769 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3Zt4hbvMPRvdCNfyDwoOT19efl3pWKFll6rlxgQbLkt3Sgh_MLfs2lM-eHco30QcYS3ojVobtky6VbPhD4AFF8g0TyFspwrKZpC8tmXTyPu1SybcPNd-K2yu4vnNAivN3-I_aozQhgm7N4aqGbZUAFHtN-dwbgWeRrQQLLi6GYMD28 May 26 12:54:33.919769 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:54:33.919769 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:54:33.919769 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:54:33.919769 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:54:33.919769 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:54:33.919769 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:54:33.919769 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: 6113ad5a21fa49d6906e26db6cf348a3 May 26 12:54:33.919769 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-TestVolumeBootPattern-806308970 May 26 12:54:33.919769 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:54:33.919769 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:54:33.922590 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6113ad5a21fa49d6906e26db6cf348a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6113ad5a21fa49d6906e26db6cf348a3", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6113ad5a21fa49d6906e26db6cf348a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6113ad5a21fa49d6906e26db6cf348a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:54:33.922590 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-TestVolumeBootPattern-806308970 May 26 12:54:33.922590 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: 6113ad5a21fa49d6906e26db6cf348a3 May 26 12:54:33.922590 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-TestVolumeBootPattern-806308970 May 26 12:54:33.922590 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-TestVolumeBootPattern-806308970-project May 26 12:54:33.922590 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:54:33.922590 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:54:33.922590 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: 3c4e48e94f934a3baf6a09a2b2d8f85d May 26 12:54:33.922590 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-TestVolumeBootPattern-806308970-project May 26 12:54:33.922590 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: > May 26 12:54:33.922590 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Instance f8b4f1e9-93a4-4aa9-97e0-398126621e15 could not be found. May 26 12:54:33.922590 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': 'f8b4f1e9-93a4-4aa9-97e0-398126621e15'} May 26 12:54:33.924019 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:54:33.924019 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:33.924019 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:54:33.924019 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:54:33.924019 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:54:33.924019 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:54:33.924019 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:54:33.924019 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:54:33.924019 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:54:33.924019 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:54:33.924019 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8b4f1e9-93a4-4aa9-97e0-398126621e15 could not be found. May 26 12:54:33.924019 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:54:33.924019 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:33.924019 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:54:33.924019 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:33.924019 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:33.924019 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:33.924019 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:54:33.924019 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:54:33.924019 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:54:33.927337 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:54:33.927337 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:54:33.927337 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:54:33.927337 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:54:33.927337 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:54:33.927337 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:54:33.927337 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:54:33.927337 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8b4f1e9-93a4-4aa9-97e0-398126621e15 could not be found. May 26 12:54:33.927337 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:54:33.927337 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:33.927337 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:54:33.927337 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:33.927337 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:33.927337 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:33.927337 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:54:33.927337 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:54:33.927337 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8b4f1e9-93a4-4aa9-97e0-398126621e15 could not be found. May 26 12:54:33.927337 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:54:33.930058 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-f2b4b84f-46bc-4781-b7ab-38f29d42e8ad tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Returning 404 to user: Instance f8b4f1e9-93a4-4aa9-97e0-398126621e15 could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:54:33.930058 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-f2b4b84f-46bc-4781-b7ab-38f29d42e8ad tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15" status: 404 len: 111 microversion: 2.1 time: 0.034133 May 26 12:54:33.930058 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 668/1345] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:54:33 2022] GET /compute/v2.1/servers/f8b4f1e9-93a4-4aa9-97e0-398126621e15 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:54:37.034475 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-6a7282e7-99a4-4203-a41f-e5f7d98d8021 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:37.035303 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-6a7282e7-99a4-4203-a41f-e5f7d98d8021 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: 0268c5aa-8924-4b57-bdfe-6b818b4d4c52] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:37.041269 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-b4c07f9b-114c-498b-81f2-35a21e0a334d req-22c5e541-2116-4c1b-a436-fc380a178232 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0268c5aa-8924-4b57-bdfe-6b818b4d4c52", "tag": "ce093c52-1d57-4f51-aea3-ea26c167d87d"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:37.042315 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6a7282e7-99a4-4203-a41f-e5f7d98d8021 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:37.042765 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6a7282e7-99a4-4203-a41f-e5f7d98d8021 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:37.043544 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6a7282e7-99a4-4203-a41f-e5f7d98d8021 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:37.043979 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-6a7282e7-99a4-4203-a41f-e5f7d98d8021 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:37.054004 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-b4c07f9b-114c-498b-81f2-35a21e0a334d req-22c5e541-2116-4c1b-a436-fc380a178232 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:37.054439 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-b4c07f9b-114c-498b-81f2-35a21e0a334d req-22c5e541-2116-4c1b-a436-fc380a178232 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:37.068034 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-b4c07f9b-114c-498b-81f2-35a21e0a334d req-22c5e541-2116-4c1b-a436-fc380a178232 service nova] Creating event network-changed:ce093c52-1d57-4f51-aea3-ea26c167d87d for instance 0268c5aa-8924-4b57-bdfe-6b818b4d4c52 on hv-cinder-81514 May 26 12:54:37.074681 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-b4c07f9b-114c-498b-81f2-35a21e0a334d req-22c5e541-2116-4c1b-a436-fc380a178232 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039377 May 26 12:54:37.075615 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 669/1346] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:54:37.080637 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-6a7282e7-99a4-4203-a41f-e5f7d98d8021 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: 0268c5aa-8924-4b57-bdfe-6b818b4d4c52] Going to try to terminate instance {{(pid=124134) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:54:37.182680 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-6a7282e7-99a4-4203-a41f-e5f7d98d8021 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52" status: 204 len: 0 microversion: 2.1 time: 0.151834 May 26 12:54:37.183598 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 678/1347] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:54:37 2022] DELETE /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 12:54:37.193047 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-a3fe1a32-a559-4d32-9211-2d044d9ccc89 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:37.193749 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-a3fe1a32-a559-4d32-9211-2d044d9ccc89 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: 0268c5aa-8924-4b57-bdfe-6b818b4d4c52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:37.200812 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a3fe1a32-a559-4d32-9211-2d044d9ccc89 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:37.201269 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a3fe1a32-a559-4d32-9211-2d044d9ccc89 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:37.202598 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a3fe1a32-a559-4d32-9211-2d044d9ccc89 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:37.203050 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-a3fe1a32-a559-4d32-9211-2d044d9ccc89 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:37.346032 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.policy [None req-a3fe1a32-a559-4d32-9211-2d044d9ccc89 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124133) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:37.354475 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-a3fe1a32-a559-4d32-9211-2d044d9ccc89 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52" status: 200 len: 1579 microversion: 2.1 time: 0.166466 May 26 12:54:37.355045 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 670/1348] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:54:37 2022] GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52 => generated 1579 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:38.373332 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-0b8c44bc-4ac1-49a1-92f3-28e174c28aeb tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:38.374123 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-0b8c44bc-4ac1-49a1-92f3-28e174c28aeb tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: 0268c5aa-8924-4b57-bdfe-6b818b4d4c52] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:38.380827 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0b8c44bc-4ac1-49a1-92f3-28e174c28aeb tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:38.381273 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0b8c44bc-4ac1-49a1-92f3-28e174c28aeb tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:38.382049 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0b8c44bc-4ac1-49a1-92f3-28e174c28aeb tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:38.382477 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-0b8c44bc-4ac1-49a1-92f3-28e174c28aeb tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:38.529106 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-0b8c44bc-4ac1-49a1-92f3-28e174c28aeb tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:38.537686 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-0b8c44bc-4ac1-49a1-92f3-28e174c28aeb tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52" status: 200 len: 1579 microversion: 2.1 time: 0.168769 May 26 12:54:38.538270 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 679/1349] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:54:38 2022] GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52 => generated 1579 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:39.453446 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [req-83717916-9c6d-4474-b235-f5770c575399 req-2c957e70-92f7-43a3-82e5-bff5f2ae2d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0268c5aa-8924-4b57-bdfe-6b818b4d4c52", "name": "network-vif-deleted", "tag": "ce093c52-1d57-4f51-aea3-ea26c167d87d"}]} {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:39.463798 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-83717916-9c6d-4474-b235-f5770c575399 req-2c957e70-92f7-43a3-82e5-bff5f2ae2d79 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:39.464200 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [req-83717916-9c6d-4474-b235-f5770c575399 req-2c957e70-92f7-43a3-82e5-bff5f2ae2d79 service nova] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:39.475642 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.compute.server_external_events [req-83717916-9c6d-4474-b235-f5770c575399 req-2c957e70-92f7-43a3-82e5-bff5f2ae2d79 service nova] Creating event network-vif-deleted:ce093c52-1d57-4f51-aea3-ea26c167d87d for instance 0268c5aa-8924-4b57-bdfe-6b818b4d4c52 on hv-cinder-81514 May 26 12:54:39.480848 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [req-83717916-9c6d-4474-b235-f5770c575399 req-2c957e70-92f7-43a3-82e5-bff5f2ae2d79 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031051 May 26 12:54:39.481468 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 671/1350] 10.222.0.39 () {64 vars in 1317 bytes} [Thu May 26 12:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:54:39.555790 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-024cc710-0965-48c2-979e-e370558eff52 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:39.556417 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-024cc710-0965-48c2-979e-e370558eff52 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: 0268c5aa-8924-4b57-bdfe-6b818b4d4c52] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:39.563555 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-024cc710-0965-48c2-979e-e370558eff52 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:39.564060 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-024cc710-0965-48c2-979e-e370558eff52 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:39.564857 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-024cc710-0965-48c2-979e-e370558eff52 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:39.565291 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-024cc710-0965-48c2-979e-e370558eff52 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:39.631990 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.policy [None req-024cc710-0965-48c2-979e-e370558eff52 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c4e48e94f934a3baf6a09a2b2d8f85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6113ad5a21fa49d6906e26db6cf348a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124134) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:39.639785 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-024cc710-0965-48c2-979e-e370558eff52 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52" status: 200 len: 1226 microversion: 2.1 time: 0.088782 May 26 12:54:39.640350 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 680/1351] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:54:39 2022] GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:40.658195 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-77c51cce-aca8-44a1-b9c1-076af566ff21 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:40.658952 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-77c51cce-aca8-44a1-b9c1-076af566ff21 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: 0268c5aa-8924-4b57-bdfe-6b818b4d4c52] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:40.665432 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-77c51cce-aca8-44a1-b9c1-076af566ff21 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:40.665880 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-77c51cce-aca8-44a1-b9c1-076af566ff21 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:40.666742 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-77c51cce-aca8-44a1-b9c1-076af566ff21 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:40.667209 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-77c51cce-aca8-44a1-b9c1-076af566ff21 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:40.681793 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-77c51cce-aca8-44a1-b9c1-076af566ff21 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] HTTP exception thrown: Instance 0268c5aa-8924-4b57-bdfe-6b818b4d4c52 could not be found. May 26 12:54:40.683422 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-77c51cce-aca8-44a1-b9c1-076af566ff21 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Request method failure captured: May 26 12:54:40.683422 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52 HTTP/1.1 May 26 12:54:40.683422 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:54:40.683422 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:54:40.683422 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:54:40.683422 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:54:40.683422 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:54:40.683422 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:54:40.683422 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:54:40.683422 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:54:40.683422 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3Zt4hbvMPRvdCNfyDwoOT19efl3pWKFll6rlxgQbLkt3Sgh_MLfs2lM-eHco30QcYS3ojVobtky6VbPhD4AFF8g0TyFspwrKZpC8tmXTyPu1SybcPNd-K2yu4vnNAivN3-I_aozQhgm7N4aqGbZUAFHtN-dwbgWeRrQQLLi6GYMD28 May 26 12:54:40.683422 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:54:40.683422 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:54:40.683422 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:54:40.683422 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:54:40.683422 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:54:40.683422 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:54:40.683422 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: 6113ad5a21fa49d6906e26db6cf348a3 May 26 12:54:40.683422 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-TestVolumeBootPattern-806308970 May 26 12:54:40.683422 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:54:40.683422 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:54:40.685163 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6113ad5a21fa49d6906e26db6cf348a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6113ad5a21fa49d6906e26db6cf348a3", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6113ad5a21fa49d6906e26db6cf348a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6113ad5a21fa49d6906e26db6cf348a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:54:40.685163 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-TestVolumeBootPattern-806308970 May 26 12:54:40.685163 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: 6113ad5a21fa49d6906e26db6cf348a3 May 26 12:54:40.685163 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-TestVolumeBootPattern-806308970 May 26 12:54:40.685163 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-TestVolumeBootPattern-806308970-project May 26 12:54:40.685163 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:54:40.685163 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:54:40.685163 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: 3c4e48e94f934a3baf6a09a2b2d8f85d May 26 12:54:40.685163 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-TestVolumeBootPattern-806308970-project May 26 12:54:40.685163 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: > May 26 12:54:40.685163 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Instance 0268c5aa-8924-4b57-bdfe-6b818b4d4c52 could not be found. May 26 12:54:40.685163 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': '0268c5aa-8924-4b57-bdfe-6b818b4d4c52'} May 26 12:54:40.686131 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:54:40.686131 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:40.686131 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:54:40.686131 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:54:40.686131 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:54:40.686131 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:54:40.686131 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:54:40.686131 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:54:40.686131 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:54:40.686131 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:54:40.686131 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0268c5aa-8924-4b57-bdfe-6b818b4d4c52 could not be found. May 26 12:54:40.686131 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:54:40.686131 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:40.686131 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:54:40.686131 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:40.686131 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:40.686131 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:40.686131 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:54:40.686131 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:54:40.686131 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:54:40.687909 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:54:40.687909 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:54:40.687909 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:54:40.687909 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:54:40.687909 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:54:40.687909 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:54:40.687909 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:54:40.687909 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0268c5aa-8924-4b57-bdfe-6b818b4d4c52 could not be found. May 26 12:54:40.687909 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:54:40.687909 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:40.687909 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:54:40.687909 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:40.687909 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:40.687909 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:40.687909 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:54:40.687909 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:54:40.687909 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0268c5aa-8924-4b57-bdfe-6b818b4d4c52 could not be found. May 26 12:54:40.687909 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:54:40.689573 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-77c51cce-aca8-44a1-b9c1-076af566ff21 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Returning 404 to user: Instance 0268c5aa-8924-4b57-bdfe-6b818b4d4c52 could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:54:40.689573 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-77c51cce-aca8-44a1-b9c1-076af566ff21 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52" status: 404 len: 111 microversion: 2.1 time: 0.031464 May 26 12:54:40.689573 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 672/1352] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:54:40 2022] GET /compute/v2.1/servers/0268c5aa-8924-4b57-bdfe-6b818b4d4c52 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:54:41.153957 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-cf14fcad-71dc-470d-a3a1-3a0b475197f2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:41.154494 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.compute.api [None req-cf14fcad-71dc-470d-a3a1-3a0b475197f2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124134) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:41.161151 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cf14fcad-71dc-470d-a3a1-3a0b475197f2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:41.161590 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cf14fcad-71dc-470d-a3a1-3a0b475197f2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:41.162348 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cf14fcad-71dc-470d-a3a1-3a0b475197f2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:41.162781 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG oslo_concurrency.lockutils [None req-cf14fcad-71dc-470d-a3a1-3a0b475197f2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:41.177580 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.wsgi [None req-cf14fcad-71dc-470d-a3a1-3a0b475197f2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] HTTP exception thrown: Instance a48ffb19-6386-4b90-93f7-16e01c3060da could not be found. May 26 12:54:41.178007 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-cf14fcad-71dc-470d-a3a1-3a0b475197f2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Request method failure captured: May 26 12:54:41.178007 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: request: DELETE /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da HTTP/1.1 May 26 12:54:41.178007 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept: application/json May 26 12:54:41.178007 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Accept-Encoding: identity May 26 12:54:41.178007 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Connection: close May 26 12:54:41.178007 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Length: 0 May 26 12:54:41.178007 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Content-Type: application/json May 26 12:54:41.178007 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Host: 10.222.0.39 May 26 12:54:41.178007 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Openstack-System-Scope: None May 26 12:54:41.178007 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: User-Agent: python-urllib3/1.26.9 May 26 12:54:41.178007 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Auth-Token: gAAAAABij3Zt4hbvMPRvdCNfyDwoOT19efl3pWKFll6rlxgQbLkt3Sgh_MLfs2lM-eHco30QcYS3ojVobtky6VbPhD4AFF8g0TyFspwrKZpC8tmXTyPu1SybcPNd-K2yu4vnNAivN3-I_aozQhgm7N4aqGbZUAFHtN-dwbgWeRrQQLLi6GYMD28 May 26 12:54:41.178007 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Id: None May 26 12:54:41.178007 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Domain-Name: None May 26 12:54:41.178007 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Identity-Status: Confirmed May 26 12:54:41.178007 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Is-Admin-Project: True May 26 12:54:41.178007 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Id: default May 26 12:54:41.178007 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Domain-Name: Default May 26 12:54:41.178007 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Id: 6113ad5a21fa49d6906e26db6cf348a3 May 26 12:54:41.178007 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Project-Name: tempest-TestVolumeBootPattern-806308970 May 26 12:54:41.178007 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Role: member,reader May 26 12:54:41.178007 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Roles: member,reader May 26 12:54:41.179696 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6113ad5a21fa49d6906e26db6cf348a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6113ad5a21fa49d6906e26db6cf348a3", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6113ad5a21fa49d6906e26db6cf348a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6113ad5a21fa49d6906e26db6cf348a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:54:41.179696 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant: tempest-TestVolumeBootPattern-806308970 May 26 12:54:41.179696 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Id: 6113ad5a21fa49d6906e26db6cf348a3 May 26 12:54:41.179696 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-Tenant-Name: tempest-TestVolumeBootPattern-806308970 May 26 12:54:41.179696 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User: tempest-TestVolumeBootPattern-806308970-project May 26 12:54:41.179696 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Id: default May 26 12:54:41.179696 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Domain-Name: Default May 26 12:54:41.179696 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Id: 3c4e48e94f934a3baf6a09a2b2d8f85d May 26 12:54:41.179696 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: X-User-Name: tempest-TestVolumeBootPattern-806308970-project May 26 12:54:41.179696 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: method: > May 26 12:54:41.179696 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: exception: Instance a48ffb19-6386-4b90-93f7-16e01c3060da could not be found. May 26 12:54:41.179696 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: action_args: {'id': 'a48ffb19-6386-4b90-93f7-16e01c3060da'} May 26 12:54:41.180859 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:54:41.180859 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:41.180859 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:54:41.180859 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:54:41.180859 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:54:41.180859 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:54:41.180859 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:54:41.180859 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:54:41.180859 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:54:41.180859 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:54:41.180859 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48ffb19-6386-4b90-93f7-16e01c3060da could not be found. May 26 12:54:41.180859 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:54:41.180859 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:41.180859 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:54:41.180859 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:41.180859 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:41.180859 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:41.180859 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:54:41.180859 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:54:41.180859 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:54:41.182449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:54:41.182449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:54:41.182449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:54:41.182449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:54:41.182449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:54:41.182449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:54:41.182449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:54:41.182449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:54:41.182449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:54:41.182449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48ffb19-6386-4b90-93f7-16e01c3060da could not be found. May 26 12:54:41.182449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:54:41.182449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:41.182449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:54:41.182449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:41.182449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:41.182449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:41.182449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:54:41.182449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:54:41.182449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48ffb19-6386-4b90-93f7-16e01c3060da could not be found. May 26 12:54:41.182449 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR nova.api.openstack.wsgi May 26 12:54:41.184196 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-cf14fcad-71dc-470d-a3a1-3a0b475197f2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Returning 404 to user: Instance a48ffb19-6386-4b90-93f7-16e01c3060da could not be found. {{(pid=124134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:54:41.184196 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-cf14fcad-71dc-470d-a3a1-3a0b475197f2 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 404 len: 111 microversion: 2.1 time: 0.029594 May 26 12:54:41.184196 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 681/1353] 10.222.0.39 () {58 vars in 1238 bytes} [Thu May 26 12:54:41 2022] DELETE /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:54:41.188164 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-06428e9e-1919-4098-83ba-d76a6665ddae tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '>' {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:41.188850 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.compute.api [None req-06428e9e-1919-4098-83ba-d76a6665ddae tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [instance: a48ffb19-6386-4b90-93f7-16e01c3060da] Fetching instance by UUID {{(pid=124133) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:41.195713 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-06428e9e-1919-4098-83ba-d76a6665ddae tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:41.196163 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-06428e9e-1919-4098-83ba-d76a6665ddae tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:41.196964 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-06428e9e-1919-4098-83ba-d76a6665ddae tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:41.197404 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG oslo_concurrency.lockutils [None req-06428e9e-1919-4098-83ba-d76a6665ddae tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Lock "647fb890-3516-4fd3-bb90-bcfdb9dc4d4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:41.211744 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.wsgi [None req-06428e9e-1919-4098-83ba-d76a6665ddae tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] HTTP exception thrown: Instance a48ffb19-6386-4b90-93f7-16e01c3060da could not be found. May 26 12:54:41.213291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-06428e9e-1919-4098-83ba-d76a6665ddae tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Request method failure captured: May 26 12:54:41.213291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: request: GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da HTTP/1.1 May 26 12:54:41.213291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept: application/json May 26 12:54:41.213291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Accept-Encoding: identity May 26 12:54:41.213291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Connection: close May 26 12:54:41.213291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Length: 0 May 26 12:54:41.213291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Content-Type: application/json May 26 12:54:41.213291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Host: 10.222.0.39 May 26 12:54:41.213291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Openstack-System-Scope: None May 26 12:54:41.213291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: User-Agent: python-urllib3/1.26.9 May 26 12:54:41.213291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Auth-Token: gAAAAABij3Zt4hbvMPRvdCNfyDwoOT19efl3pWKFll6rlxgQbLkt3Sgh_MLfs2lM-eHco30QcYS3ojVobtky6VbPhD4AFF8g0TyFspwrKZpC8tmXTyPu1SybcPNd-K2yu4vnNAivN3-I_aozQhgm7N4aqGbZUAFHtN-dwbgWeRrQQLLi6GYMD28 May 26 12:54:41.213291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Id: None May 26 12:54:41.213291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Domain-Name: None May 26 12:54:41.213291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Identity-Status: Confirmed May 26 12:54:41.213291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Is-Admin-Project: True May 26 12:54:41.213291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Id: default May 26 12:54:41.213291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Domain-Name: Default May 26 12:54:41.213291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Id: 6113ad5a21fa49d6906e26db6cf348a3 May 26 12:54:41.213291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Project-Name: tempest-TestVolumeBootPattern-806308970 May 26 12:54:41.213291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Role: member,reader May 26 12:54:41.213291 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Roles: member,reader May 26 12:54:41.215501 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6113ad5a21fa49d6906e26db6cf348a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6113ad5a21fa49d6906e26db6cf348a3", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6113ad5a21fa49d6906e26db6cf348a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6113ad5a21fa49d6906e26db6cf348a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] May 26 12:54:41.215501 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant: tempest-TestVolumeBootPattern-806308970 May 26 12:54:41.215501 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Id: 6113ad5a21fa49d6906e26db6cf348a3 May 26 12:54:41.215501 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-Tenant-Name: tempest-TestVolumeBootPattern-806308970 May 26 12:54:41.215501 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User: tempest-TestVolumeBootPattern-806308970-project May 26 12:54:41.215501 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Id: default May 26 12:54:41.215501 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Domain-Name: Default May 26 12:54:41.215501 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Id: 3c4e48e94f934a3baf6a09a2b2d8f85d May 26 12:54:41.215501 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: X-User-Name: tempest-TestVolumeBootPattern-806308970-project May 26 12:54:41.215501 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: method: > May 26 12:54:41.215501 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: exception: Instance a48ffb19-6386-4b90-93f7-16e01c3060da could not be found. May 26 12:54:41.215501 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: action_args: {'id': 'a48ffb19-6386-4b90-93f7-16e01c3060da'} May 26 12:54:41.216683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: {{(pid=124133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:54:41.216683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:41.216683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:54:41.216683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:54:41.216683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:54:41.216683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:54:41.216683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:54:41.216683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:54:41.216683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:54:41.216683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:54:41.216683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48ffb19-6386-4b90-93f7-16e01c3060da could not be found. May 26 12:54:41.216683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:54:41.216683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:41.216683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:54:41.216683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:41.216683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:41.216683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:41.216683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:54:41.216683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:54:41.216683 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:54:41.218519 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:54:41.218519 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:54:41.218519 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:54:41.218519 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:54:41.218519 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:54:41.218519 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:54:41.218519 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:54:41.218519 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48ffb19-6386-4b90-93f7-16e01c3060da could not be found. May 26 12:54:41.218519 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:54:41.218519 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:41.218519 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:54:41.218519 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:41.218519 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:41.218519 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:41.218519 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:54:41.218519 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:54:41.218519 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48ffb19-6386-4b90-93f7-16e01c3060da could not be found. May 26 12:54:41.218519 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: ERROR nova.api.openstack.wsgi May 26 12:54:41.219977 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: DEBUG nova.api.openstack.wsgi [None req-06428e9e-1919-4098-83ba-d76a6665ddae tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Returning 404 to user: Instance a48ffb19-6386-4b90-93f7-16e01c3060da could not be found. {{(pid=124133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:54:41.219977 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO nova.api.openstack.requestlog [None req-06428e9e-1919-4098-83ba-d76a6665ddae tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da" status: 404 len: 111 microversion: 2.1 time: 0.030430 May 26 12:54:41.219977 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: [pid: 124133|app: 0|req: 673/1354] 10.222.0.39 () {58 vars in 1235 bytes} [Thu May 26 12:54:41 2022] GET /compute/v2.1/servers/a48ffb19-6386-4b90-93f7-16e01c3060da => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:54:42.522106 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: DEBUG nova.api.openstack.wsgi [None req-b085e6b0-a818-4624-a775-71d0442c6919 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] Calling method '.version_select at 0x7fed313bad30>' {{(pid=124134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:42.525605 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b085e6b0-a818-4624-a775-71d0442c6919 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [54ecf005-a39f-4908-9b53-c66e4b203d26] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 12:54:43.533601 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO oslo.messaging._drivers.impl_rabbit [None req-b085e6b0-a818-4624-a775-71d0442c6919 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] [54ecf005-a39f-4908-9b53-c66e4b203d26] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 35904. May 26 12:54:43.553454 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO nova.api.openstack.requestlog [None req-b085e6b0-a818-4624-a775-71d0442c6919 tempest-TestVolumeBootPattern-806308970 tempest-TestVolumeBootPattern-806308970-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2095207375" status: 202 len: 0 microversion: 2.1 time: 1.035645 May 26 12:54:43.554020 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: [pid: 124134|app: 0|req: 682/1355] 10.222.0.39 () {58 vars in 1262 bytes} [Thu May 26 12:54:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2095207375 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:55:48.745783 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:55:48.746663 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Thu May 26 12:55:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 12:57:38.181672 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:57:38.182266 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Thu May 26 12:57:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 12:57:41.485428 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:57:41.486054 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Thu May 26 12:57:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 12:57:50.720553 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:57:50.721159 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Thu May 26 12:57:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 12:59:08.753943 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:59:08.754607 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Thu May 26 12:59:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 12:59:48.207656 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:59:48.208272 dv-cinder-815145-10-iscsi devstack@n-api.service[124133]: Thu May 26 12:59:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 12:59:56.316946 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:59:56.317587 dv-cinder-815145-10-iscsi devstack@n-api.service[124134]: Thu May 26 12:59:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!